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AIR  FORCE  HUMAN  RESOURCES  LABORATORY 
ORGANIZATION 


MISSION 


T lit-  \ir  Koric  Human  R eso tiroes  Laboratory 
(  A  I'll  H  1.)  is  the  Air  Force  Systems  Command  s 
organization  charged  with  planning  and  executing 
the  INAF  exploratory  and  advanced  development 
programs  for  personnel  selection,  classification,  and 
retention:  force  structure  and  utilization:  education, 
training,  and  instructional  strategies:  training 
technology  lor  simulators  and  instructional  devices: 
performance  evaluation:  and  human  resources  data 
in  system  design  and  operation.  The  Laboratory 
provides  technical  and  management  assistance  in 
support  of  studies,  analyses,  development  planning 
activities,  acquisition,  test,  evaluation,  modification, 
and  operation  of  aerospace  systems  and  related 
equipment. 


The  A  FURL  mission  is  broader  than  those  ol  most 
other  technology  laboratories  of  AFSC.  The 
hardware  laboratories  are  almost  entirely  concerned 
with  technological  development:  but  hardware 
technology  development  is  only  one  of  the 
responsibilities  of  A  FURL.  Of  equal  importance  in 
A  Fll  R  L"s  mission  is  the  development  of  information 
for  uses  in  making  management  and  policy  decisions 
on  selection,  training,  and  personnel  matters.  This 
effort  in  human  resources  technology  is  most 
important  because  the  largest  single  item  in  the 
Department  of  Defense  budget  is  the  cost  of 
personnel  and  the  associated  costs  of  training  and 
administratively  supporting  the  personnel  force. 


ORGANIZATIONAL  STRl  CTl  KK 


The  Air  Force  Human  Resources 
Laboratory  (A  FURL)  consists  of  a 
headquarters,  six  divisions,  and  two 
operating  locations.  The  Laboratory  is 
structured  for  centralized  management  with 
decentralized  operations.  The  research  and 
development  program  of  the  Laboratory  is 
centrally  managed  by  the  headquarters  staff 
located  at  R rooks  A  FH.  Texas.  The  divisions 
perform  the  research  activities  and  to  a  great 
extent  are  collocated  with  major  users  of  the 
Laboratory  products  and  services. 

Collocat  on  of  research  facilities  with  the 
users  ol  the  research  and  development 
( R Jt  D)  product  has  many  advantages.  It 
allows  for  maximum  interaction  and 
communication  between  the  research 
scientist  and  the  operational  military 
manager  It  permits  belter  understanding  of 
the  environment  and  problems  faced  both 
bv  scientist  conducting  the  research  and  the 
military  manager  implementing  the  results 
of  the  scientific  study,  (  lose  working 
arrangements  generate  mutual  support  and 
produce  technology  transfer  with  minimum  delay. 
Often,  collocation  produces  real  economic  saving 
through  mutual  use  of  equipment  and  personnel 
bv  the  research  scientist  and  the  operational 
organization.  I  bis  is  especially  true  in  the  area  of 
fly ing  training. 

The  six  divisions  of  AFHRI.  are  the  Advanced 
Systems  Division  at  ^  right -I’allerson  AFB. Ohio; 
the  Personnel  Research  Division,  the  Occupation 
and  Manpower  Research  Division,  and  the 
< .om putational  Sciences  Division  at  Hrooks  AFR. 


AFHRL  ORGANIZATIONAL  STRUCTURE 

ADVANCED  SYSTEMS  DIVISION 


COMPUtA'lONAl  SCIENCES  DIVISION 

The  \ir  Lorre  Ijuiiuil  KrMHirees  l.atiorlorv  isoisels  of  six  divisions 
anil  l ho  operating;  location?,  centrally  managed  by  ihr  headquarters 
located  al  Hrooks  V i r  Lorre  Base.  Texas 


Texas;  the  Flying  Training  Division  at  Williams 
AFB.  Arizona:  and  the  Technical  Training  Division 
at  l.owrv  AT  H.  Colorado 

In  addition  to  the  six  major  divisions.  AFHRI,  has 
established  two  operating  locations.  One  is  at  N  ASA- 
A  tiles  R esearelt  Denier,  M  offett  Field.  California  anil 
was  established  to  eoordinale  research  in  full-mission 
flight  simulation  and  flight  management  systems. 
The  other  operating  location  is  at  Luke  AFB. 
Arizona:  one  of  its  missions  is  to  conduct  research 
with  the  Tactical  Air  Command  on  simulation 
training  for  air-to-air  combat. 


.i 


PREDECESSOR  ORGANIZATIONS 


Th<‘  Air  Force  Human  Resources  Laboratory 
(AFHRL)  was  established  in  July  I')b8:  however, 
some  of  its  research  areas  span  almost  four  decades. 
Since  the  Laboratory  frequently  receives  inquiries 
concerning  technical  reports  published  before  and 
after  1968,  this  chronology  of  predeeesor 
organizations  of  AFHRL  is  provided  to  trace  the 
origins  and  continuity  of  various  research  programs 
and  documentation.  Briefly,  the  four  major 
predecessor  organizations  were  the  Psychological 
Research  l '  nits  (PR  Is):  Human  Resources 
Research  Center  (HRRC):  Air  Force  Personnel  and 
Training  Research  Center  (AFPTRC):  and 
Personnel  Research  Laboratory  (PRL). 

One  of  the  first  PR  l  s  in  the  Army  Air  Force  was 
PR  l  Number  2.  activated  If)  November  1941  at 
Kelly  Field.  San  Antonio.  Texas.  PRL  Number  1. 
previously  established  at  Maxwell  Field. 
Montgomery.  Alabama,  ceased  functioning  in  July 
1942.  On  1  July  1942.  PRl  Number  2  was 
transferred  without  change  in  duty  location  (Kelly- 
Field)  to  the  command  of  the  newly  formed  San 
Antonio  Aviation  Cadet  Center  (SAACC).  which  is 
now  Lackland  AFB.  In  September  1942.  PRL 
Number  2  was  moved  to  SAACC  and  in  October 
1944.  PRL  Number  .1  at  Santa  Ana.  California, 
merged  with  PRL  Number  2. 

On  I  July  194.1.  the  Department  of  Records  and 
Analysis.  AAF  School  of  Aviation  Medicine  (SAM) 
was  activated.  W  ith  the  inactivation  of  PR  I  N  umber 
2  on  .10  June  1941.  one  of  its  major  groups,  the 
Division  of  R ecords  and  A nalyses.  w as  transferred  to 
H(J  AAF  Central  Flying  Training  Command. 
Randolph  Field.  Texas.  Personnel  from  this  group 
were  placed  on  temporary  duty  (I  DA  )  to  the  S  AM 
department  located  at  SAACC.  In  March  1 9  40.  the 
Department  of  Records  and  Analysis.  AAF  SAM. 
was  moved  to  Randolph  Field  and  incorporated  into 
the  SAM  Statistical  Laboratory.  On  I  May  1940.  the 
Indoctrination  Division.  Psychological  Research  and 
F.xamining  L  nit  (PR  F.L)  was  established  at  the  A  AF 


.Military  Training  Center  (MTC) —  now  Lackland 
AFB.  This  unit  was  formed  from  the  Medical  and 
Ps  vc  ho  logical  Kxamining  l  nit  Number  (>. 
previously  located  at  Keesler  Field.  Mississippi.  In 
addition,  on  1.1  January  1947.  the  Aviation 
Psychological  Research  l  nit  Number  I  f formerly 
the  Psychological  Research  Project  —  Pilot )  at 
Randolph  Field  was  merged  with  PRFl  at  AAF 
MTC.  The  PRFl  was  redesignated  the  11 09th 
Research  and  Development  Croup  in  August  DOR: 
in  December  1948.  the  designation  was  changed  to 
Squadron. 

In  Julv  1949.  HRRC.  Air  Training  Command,  was 
established  with  the  1109th  R  &  D  Squadron 
incorporated  into  it  as  the  Personnel  Research 
Directorate.  This  directorate  was  redesignated  as 
PRL  on  1  June  1911.  HRRC.  was  transferred  on  I 
April  1911  to  the  Air  Research  and  Development 
Command  (ARDC) —  now  Air  Force  Systems 
Command  (AFSC). 

AFPTRC  became  operational  I  February  1914. 
replacing  HRRC.  AFPTRC  also  included  the 
Human  Resources  Research  Institute  ( 1 1  R  R  I )  from 
Maxwell  AFB  and  the  Human  Factors  Operations 
Research  Laboratory  (II  FORD  from  Rolling  AFB. 
On  2  March  19.16  at  the  direction  of  IDJ  ARDC. 
"Research"  was  dropped  from  the  name  of  the 
Laboratory.  The  Personnel  Laboratory.  AFPTRC. 
was  subsequently  redesignated  and  assigned  as 
Detachment  Number  I.  VI  right  Air  Development 
Center  (W  ADC).  AFPTRC  was  disestablished  1.1 
April  I  ’MR. 

File  Personnel  Research  Laboratory  (PRL)  was 
established  as  an  element  of  the  Aerospace  Medical 
Division  (  AMD).  AFSC.  on  I  January  1962.  PRL. 
located  at  Lackland  A FB.  continued  until  July  1908. 
when  AFHRL  was  established  with  headquarters  at 
Brooks  AFB.  Texas.  Three  of  the  AFHRL  divisions 
remained  at  Lackland  AFB  until  April  1977.  when 
they  were  colocated  with  AFHRL  headquarters  at 
Brooks  AFB. 
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ADVAM.KI)  SYS  IT-; MS  DIVISION 


The  Advanced  System  Division  contributes  to  the 
development  of  advanced  Air  Force  systems  and 
operations  through  research,  exploratory  development, 
and  advanced  development.  Major  efforts  deal  with 
acquisition  logistics,  maintenance  performance,  ground 
operations  training  and  engineering  techniques  for 
training  simulators. 

Acquisition  logistics  include  research  and  development 
to  improve  technologies  for  incorporating  logistics 
factors  into  the  design,  development,  evaluation,  and  life 
cycle  costing  of  Air  Force  weapon  systems.  The 
techniques  of  operations  research,  human  factors, 
management  science,  behavioral  science,  and  systems 
technology  are  applied  to  improve  the  capability  to 
integrate  logistics  factors  into  Defense  Systems 
Acquisition  Review  decisions;  to  assess  alternative 
system  designs  and  predict  logistics  resource 
requirements;  to  accomplish  the  logistics  support 
analysis  (LSA);  and  to  quantify  interactive  relationships 
among  the  integrated  logistics  support  (ILS)  elements. 

The  maintenance  performance  area  includes  research  and 
development  programs  to  improve  the  effectiveness  and 
efficiency  of  personnel  and  organizations  responsible  for 
the  maintenance  of  Air  Force  weapons  systems  and 
support  equipment.  Programs  involve  the  development 


of  improved  techniques  in  the  areas  of  personnel 
utilization,  training,  job  aiding,  maintenance 
management,  maintenance  policies  and  procedures,  and 
organizational  structure.  A  major  current  project  deals 
with  the  development  of  a  computer-based  technical 
order  system. 

The  ground  operations  area  consisted  of  research, 
exploratory  development  and  advanced  development  of 
techniques,  methods  and  devices  for  evaluating  and 
improving  the  performance  of  personnel  who 
operate/control  ground  based  aeronautical,  missile,  and 
electronic  weapon  and  support  systems.  Special 
emphasis  is  given  to  the  performance  of  teams,  crews 
and  units.  Research  in  this  area  will  develop  and 
demonstrate  techniques  and  devices  for  evaluating  the 
performance  of  ground  operator  teams  and  crews.  It  will 
also  determine  the  impact  on  performance  of  such 
factors  as  personnel  policies,  training,  operational 
procedures,  environmental  factors  and  organization 
policies. 

The  training  simulation  area  deals  with  such  things  as 
electro  optics,  computer  generated  imagery,  and 
motion  cues  for  flight  simulators  that  are  realistic  yet 
cost  -effective.  This  area  will  eventually  be  transferred  to 
the  Flying  Training  Division  of  AFHRL. 


COMPUTATIONAL  SCIENCES  DIVISION 


The  Computational  Sciences  Division  operates  the 
AFHRL  scientific  research,  mathematical,  and 
statistical  computer  data  processing  center  in  support 
of  the  other  Laboratory  divisions.  It  designs 
advanced  rapid  retrieval  techniques  for  data  bases 
and  provides  statistical  analyses  of  personnel  and 
training  research  data  for  a  variety  of  agencies. 

The  Computational  Sciences  Division  has  developed 
a  series  of  data  bases  containing  information  -n 
personnel  and  training  systems.  The  data  bases  are 
stored  on  magnetic  tape.  Software  to  process, 
organize,  and  display  selected  information  from  a 
single  data  base  and  to  consolidate  information  on  a 
common  subgroup  from  two  or  more  data  bases  has 
been  implemented.  The  data  bases  include  records 
on  all  active  dutv  Air  Force  enlisted  and  officer 
personnel  at  6-month  intervals:  Air  Force  Reserve 
and  National  Guard  personnel;  records  of  graduates 
from  basic  military  training,  technical  training. 


and  flying  training  programs,  and  from  the  Officer 
T raining  School  and  R  eserve  Officer  T raining  Corps 
commissioning  programs:  and  records  reflecting 
separations  and  losses  from  active  duty.  Special 
purpose  longitudinal  files  have  been  derived  from 
these  data  bases.  These  longitudinal  files  significantly 
reduce  data  processing  requirements  in  many 
personnel  and  training  research  studies. 

The  Computational  Sciences  Division  develops 
statistical  and  mathematical  procedures  to  analyze 
data  arising  in  research  projects  throughout  the 
laboratory.  Special  techniques  have  been 
implemented  to  analyze  the  psychometric 
characteristics  of  aptitude,  interest,  and  attitude  tests 
and  questionnaires.  Other  techniques  have  been 
developed  and  programmed  to  combine  background 
information  optimally;  analysis  using  these  methods 
are  used  to  improve  Air  Force  personnel  selection 
and  assignment  procedures. 


The  modern  scientific  data 
processing  center  of  the  Com¬ 
putational  Sciences  Division 
provides  statistical  analysis 
and  computational  support  to 
\  I  II  It  I .  div  isions  and  v  arious 
other  agencies. 


FLYING  TRAINING  DIVISION 


Tile  \dvann‘<l  Simulator  for  Pilot  'I' raining  at 
Williams  \FH  is  a  marvrl  of  technology  ami  has 
been  effective^  used  both  in  research  and 
training.  Originallv  configured  as  a  T-.H7H 
aircraft,  tin'  system  has  hern  modified  to  trail) 
pilots  transitioning  to  the  \-|0  aircraft. 


Responsibility  for  research  and  development  in 
flying  training  technology  for  AF’HRL  resides  with 
the  Flying  Training  Division.  This  division  develops, 
tests,  and  evaluates  existing  and  newly-developed 
hardware,  programs,  procedures,  and  techniques  for 
improving  all  phases  of  flying  training  programs. 
The  Division  is  collocated  with  the  Air  Training 
Command  (ATC)  at  Williams  AFB,  Arizona,  and 
has  an  operating  location  at  Luke  AFB,  Arizona, 
with  the  Tactical  Air  Command  (TAC).  The 
Division  facilities  are  accessible  to  the  Air  Force 
flying  commands  (ATC,  TAC,  Military  Airlift 
Command,  and  Strategic  Air  Command)  and  serves 
the  Navy  and  Army  as  well.  The  close  proximity  to 
the  Cila  Bend  Gunnery  Range,  Tactical  Fighter 
Weapons  Center,  and  the  Air  Force  Flight  Test 
Center  enhances  its  interface  with  the  operational 
community. 

The  Flying  T raining  Division  operates  the  Advanced 
Simulator  for  Pilot  Training  (ASPT)  and  conducts 
studies  to  exploit  simulator  capabilities  for 
improving  flying.  ASPT  is  the  Air  Force’s  most 
advanced  and  sophisticated  simulator  developed  for 
aircrew  training  and  research.  Originally  configured 


as  a  T-37B  aircraft,  the  simulator  system  has  been 
modified  to  simulate  the  A-10  aircraft  and  is  now 
being  modified  to  simulate  advanced  aircraft,  such  as 
the  F-16.  Using  the  advanced  simulator,  the  Division 
conducts  research  to  define  simulation  equipment 
and  techniques  which  may  lead  to  improved  training 
transfer  and  better  operational  simulators. 

The  Division  is  conducting  research  in  flying  skills 
maintenance  and  reacquisition,  low  level  navigation, 
air-to-air  refueling  requirements,  air  combat 
maneuvering,  air-to-ground  continuation  training 
simulator  visual  and  force  cue  requirements,  crew 
coordination,  operational  test  and  evaluation,  and  A- 
10  and  F-16  syllabus  effectiveness.  The  Division  is 
also  helping  accident  boards  simulate  the  conditions 
of  aircraft  accidents  to  improve  the  data  on  which 
their  findings  are  based. 

In  the  future,  the  Division  intends  to  assist  the 
operating  commands  in  tactics  research.  Simulation 
research  is  planned  to  determine  the  requirements 
for  simulating  the  NATO  scenario  and  wartime 
missions  to  increase  the  IISAF  force  readiness. 


OCCUPATION  AND  MANPOWER  RESEARCH  DIVISION 


The  Air  Force  has  ofdl.lMIO  members  and  thousands 
of  jobs  ranging  from  cook  to  computer  specialist, 
from  auto  mechanic  to  aerial  gunner,  and  from 
personnel  specialist  to  munition  expert.  Matching 
the  right  person  with  the  right  job  requires  job 
analysis  and  individual  qualification  assessment.  The 
A  FUR  I.  division  responsible  for  research  to 
improve  work  force  utilization  and  management  is 
the  Occupation  and  Manpower  Research  Division. 

The  Occupation  and  Manpower  Research  Division 
conducts  studies  on  methods  for  collecting, 
analyzing,  and  modeling  occupational  information: 
structuring  work  into  jobs,  specialties,  career  ladders, 
and  broader  management  categories;  and 
establishing  grade,  pay.  training,  education, 
experience,  and  other  job  requirements.  The 
Division  does  research  which  focuses  on  determining 
characteristics  of  jobs,  developing  methodologies  to 
apply  occupational  data  to  training  and  instructional 
systems,  evaluating  the  impact  of  transferability  on 


performance  and  classification  structure*,  and 
developing  the  capahilitv  to  identifv  skill 
deficiencies  and  organizational  problem  areas. 

This  Division  has  developed  a  computer-based 
Person-Job-M  ateh  ( I* J  M  )  System  that  has  been 
operationally  integrated  in  the  Air  Force  Recruiting 
Service  Procurement  Management  Information 
Svstem  (PROM  IS).  I’J  M  is  a  sophisticated  algorithm 
that  computes  an  applicant  s  best  job  options  for  a* 
much  as  7  months  in  advance  hy  comparing  In¬ 
in  terest  and  abilities  with  those  oi  his 
contemporaries  and  Air  Force  needs.  The  pritnarv 
output  of  the  system  is  an  ordered  list  of  job 
opportunities  from  which  a  person  will  choose.  The 
list  is  ordered  and  limited  so  as  to  maximize  Air 
Force  personnel  effectiveness.  Recruiters  indicate 
that  the  system,  in  matching  the  applicant's  abilities, 
interests,  and  Air  Force  needs,  virtually  guarantees 
placing  “the  right  person  in  the  right  job." 


It  eseareh  scientist.  Irorn  the 
Occupation  and  Manpower 
II  e  search  Division  modifv  the 
algorithm  for  the  I’or.nn-Joh- 
Malelt  System  (PJM  t.  TIM  is 
an  operational,  computer- 
based,  joh  assignment  svslcm 
developed  In  the  I  aboratorv 
to  optimally  match  new 
recruits  with  \ir  l  orn-  joh 
requirement*. 


if) 


PERSONNEL  RESEARCH  DIVISION 


\>  juirl  ol  Hrsrarch  on  \ir  I'orrr  l'«*inal<* 
Pilot  Program,  pilot  applicant  nnilcrgoi-s 
test  on  complex  task  coordinating  aliilitics 
on  an  aircrew  ps\ehoinotor  testing  de\ ice. 
I  he  stud)  was  conducted  hv  xdentists 
from  tlie  Personnel  Hesearch  [division. 


A  major  portion  of  the  Air  Force  budget  is  personnel 
cost.  A  major  contributor  to  personnel  costs  is 
attrition  of  first-term  personnel.  Of  every  100  non- 
prior  service  accessions.  15  are  lost  in  training,  with 
an  additional  10  to  12  lost  during  their  tour.  Over 
half  of  those  completing  the  first  our  and  eligible  to 
reenlist  fail  to  do  so.  The  Personnel  Research 
Division  is  doing  research  to  develop  methods  and 
devices  which  will  reduce  untimely  attrition  and 
increase  career  motivation  of  Air  Force  personnel. 

The  Personnel  Research  Division  develops 
improved  methodologies  for  the  selection, 
classification,  and  assignment  of  Air  Force  military 
personnel.  The  Division  conducts  research  into  the 
nature  of  individual  differences,  methods  of 
measuring  those  differences,  and  means  for  their 


systematic  application  in  Air  Force  selection  and 
assignment  programs.  The  Division  meets  research 
and  development  requirements  for  the  Armed 
Services  Vocational  Aptitude  Battery  to  support  Air 
Force  single  managership  of  this  battery. 

In  order  to  improve  selection  and  classification 
techniques,  the  Division  is  conducting  studies  of 
personnel  utilization,  job  satisfaction,  and  career 
development.  Among  its  research  efforts  are  projects 
to  determine  the  impart  of  assigned  work  on  job 
satisfaction,  retention,  and  the  development  of 
career  intent.  Efforts  toward  the  development  of 
measures  of  job  performance  to  be  used  as  criteria  for 
selection  and  classification  measures  have  led  to  the 
development  of  a  performance  appraisal  system  for 
Air  Force  civilian  personnel. 


« 


II 


TECHNICAL  TRAINING  DIVISION 


The  Air  Force  inventory  includes  a  vast  array  of 
complex  and  highly  technical  weapons  and  delivery 
systems.  The  sophistication  of  these  systems,  the 
need  to  maintain  a  high  level  of  readiness  and  the 
inherent  personnel  turnover  of  a  voluntary  military 
system  demand  a  high  level  of  technical  training  and 
skill  upgrading  activiity.  To  meet  the  need  for 
continual  training,  the  Air  Force  has  evolved 
complementary  systems  of  resident  technical  schools 
and  formal  on-the-job  training  (OJT). 

The  Technical  Training  Division  is  responsible  for 
research  in  the  areas  of  technical  training, 
particularly  for  developing,  demonstrating,  and 
evaluating  improved  methods,  media,  and  systems 
for  technical  training.  The  Division  is  doing  research 
to  determine  what  training  is  best  accomplished  in 
resident  and  what  training  should  be  done  on  the  job. 

The  Technical  Training  Division  has  developed  an 
individualized,  computer-based,  multi-media. 
Advanced  Instructional  System  (AIS).  The  system 
was  designed  to  provide  technical  training  and 


course  management  for  up  to  2,100  students  per  day 
in  four  selected  courses  at  the  ATC  Lowry  Technical 
Training  Center  (LTTC)  and  to  provide  a  research 
facility  for  a  continuing  program  on  development 
and  test  of  instructional  technology.  System 
development  and  integrated  system  test  were 
completed  in  October  1977,  and  the  instructional 
portions  of  AIS  for  the  four  technical  training 
courses  were  transitioned  to  LTTC  at  that  time.  The 
system  demonstrated  significant  student  time  saving 
when  compared  to  conventional  methods  of  training 
while  maintaining  and  improving  quality  of 
graduates. 

Continued  research  in  the  areas  of  computer-assisted 
instruction,  computer-managed  instruction,  the 
development  of  simulators  for  maintenance  training, 
and  the  development  and  evaluation  of  instructional 
and  management  techniques  to  improve  the  cost 
effectiveness  of  the  Air  Force  OJT  system  are  the 
major  research  and  development  (R&  D)  Thrust  of 
the  Division. 


\ L M  R I .  Project  Scientist.  working  with  an  Air  Training  Cmmntand  Instructor,  tests  the  Kl  I  lit  (h88.'t)  Flight 
(  (inverter  Station. 
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FLYING  TRAIN  EM.  TECHNOLOGY 


Title :  Advanced  Training  Features  and  Concepts  in 
Using  Training  Simulation 

Description  :  In  the  first  of  a  series  of  studies  to  be 
conducted,  pilots  acquired  a  manual  weapons 
delivery  task  (the  30-degree  disc  bomb  task)  under 
an  approach  where  the  last  link  in  the  response  chain 
was  acquired  first.  Performances  under  this 
approach,  called  bat  kward  chaining,  were  compared 
to  those  of  pilots  who  acquired  the  same  task  under 
the  more  traditional  whole  task  method.  When 
training  time  for  the  two  methods  was  equated,  the 
accuracy  for  pilots  trained  under  the  backward 
chaining  method  was  significantly  better  than  that 
for  pilots  trained  under  the  whole  task  method.  Of 
additional  interest  is  that  in  the  time  required  for 
seven  of  10  pilots  in  the  backward  chaining  group  to 
reach  criterion,  only  three  of  10  pilots  in  the  entire 
task  group  had  done  so.  A  second,  closely  related, 
study  sought  to  further  extend  the  training 
efficiencies  developed  in  the  earlier  study.  In  this 
second  study,  the  simulator  arranged  for  the 
presentation  of  immediate  visual  feedback  as  to  the 
bomb's  impact  as  well  as  to  automatically  reset  the 
simulator  to  the  exact  conditions  present  at  the  time 
the  bomb  was  released.  Through  the  use  of 
immediate  feedback  and  "freeze.'"  a  significant 
reduction  was  obtained  in  the  number  of  training 
trials  needed  to  acquire  proficiency  in  the  critical 
final  leg  portion  of  the  task.  Research  is  continuing 
to  explore  ways  of  improving  the  instructional 
effectiveness  of  these  and  other  automated 
instructional  support  features.  A  third  study  in  the 
series  addressed  the  effectiveness  of  the  simulator  s 
record/play  back  feature  as  compared  to  the  use  of  the 
same  amount  of  time  for  additional  student  practice. 
The  task  was  the  first  two  leaves  of  a  clovorleaf 
maneuver.  Students  were  undergraduate  pilot 
training  (l  PT)  students  at  a  pre-solo  phase  of 
training.  The  results  showed  that  by  the  end  of 
training,  the  performance  of  students  receiving  the 
plavbacks  was  no  better  than  that  of  students  who 
were  simply  given  the  same  amount  of  time  for 
additional  practice.  In  a  study  soon  to  be  conducted 
with  the  Naval  Training  Kquipment  Center  on  the 
Visual  Technology  Research  Simulator,  the  use  of 
augmented  visual  feedback  and  freeze  will  be 


evaluated  within  the  context  of  a  carrier  landing  task 
The  task  is  similar  to  the  weapons  delivery  task  as 
well  as  to  the  overhead  traffic  pattern  acquired  early 
in  training  bv  the  Air  Force  students.  The  focus  of 
work  in  the  coming  rear  will  turn  to  the 
development  and  applieation  of  advanced  training 
features  and  concepts  for  tactical  flight  simulation. 
Studies  are  planned  which  will  address  specifically 
the  utilization  of  the  A-10  in  a  simulated  high  threat 
environment. 

Impact:  These  studies  have  provided  a  clear 

demonstration  of  the  ways  in  which  advanced 
instructional  support  features  of  a  flight  simulator 
can  be  applied  in  actual  operational  training 
situations.  The  backward  chaining  approach  to  the 
weapons  delivery  task  has  been  favorably  received 
hv  simulator  users  in  the  Tactical  Air  Command 
(TAC)  and  is  imparting  simulator  training  being 
conducted  for  TAC  on  the  F-Ul  configuration  of  the 
Advanced  Simulator  for  Pilot  Training  (ASPT). 

Benefits:  The  results  of  studies  such  as  these  are 
helpful  to  those  who  utilize  flight  simulators,  and 
point  out  which  instructional  support  features  offer 
promise  of  greater  training  efficiencies  and  which 
mav  not.  Together,  the  results  of  such  studies  permit 
She  evenlual  development  of  more  effective 
automated  approaches  to  flying  training  instruction. 


Tide:  Airrrew  Performance  Measurement  for  Air 
Combat  Maneuvering  Training 

Description :  Exploratory  studies  were  initialed  to 
define  and  describe  candidate  concepts  for 
measuring  aircrew  performance  in  simulators  that 
provide  Air  Combat  Maneuvering  (ACM)  training. 
Two  contract  efforts  were  completed  and  will  he  used 
in  subsequent  development  of  aircrew  Performance 
Measurement  (PM)  systems.  One  effort  provided  a 
validation  study  of  the  Cood  .Stick  Index  (CSD.  The 
OS1  is  a  measure  of  the  training  Tactical  Air 
Command  and  Aerospace  Defense  Command  pilots 
receive  during  contract  ACM  training  programs  at 
the  Vought  Corporation  Simulation  Facility.  The 
other  effort  was  conducted  to  develop 
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an  approach  in  I’M  tnr  MM  and  to  derive 
|ir<-liiii inury  measures  Inr  the  assessment  of  one-on- 
one  Irrn  engagements  in  (lie  Simulalnr  for  Air-In-  Air 
Combat  (SAM!)  located  al  l.uke  API!  Also,  an  in- 
house  effort  was  inilialnd  In  evaluate  I’M  nii-thods 
Used  1  > n  Navy  and  Air  lone  test  units  al  MM 
ranges. 

Im  pot  I:  I  lie  rnsults  nl  these  studio  will  In-  used  in 
the  on-going  di*\ clopnn  nt  nl  performam  e  measures 
Inr  I  hr  full  range  nl  flving  training  programs. 
Although  tile  total  concept  nl  I’M  and  the  resultant 
training  effectiveness  arr  still  in  earlv  -tages  nf 
d  n  \  e  I  n  |>  to  v  n  I .  I  hr  completed  sludirs  liavr 
substantially  inrrrasrd  thr  understanding  nf  viablr 
I’M  nirthods. 

Benefits:  Drvrlnpmrnt  of  I’M  techniques  that  ran 
l»r  usrd  in  ADM  simulators  and  by  aireratt  in  live 
engagements  over  ,A(M  range  facilities  will  provide 
significant  indication  of  transfer  of  training  anti 
training  accountability. 


'fide:  Attention  and  Task  Complexity  as  Indicated  by 
Physiological  Indices 

Description :  The  objective  of  this  research  was  to 
develop  physiological  measures  nf  pilot  attention  and 
workload.  In  later  studies,  these  measures  will  be 
used  in  conjunction  with  behavioral  measures  of 
pilot  attention  and  task  difficulty  in  order  to 
optimally  st-ucture  Might  simulation  (raining 
programs  and  equipment.  One  initial  objective  was 
to  establish  laboratory  procedures  for  handling  the 
large  quantities  of  data  involved  in 
psyehophysiologieal  research  and  to  insure  that  all 
components  of  the  computer  laboratory  were 
functioning  properly  .  The  variables  of  heart  rale, 
skin  conductance,  cortical  evoked  potentials,  and  eye 
movement  have  not  been  investigated 
simultaneously  in  previous  research,  and  a  second 
major  objective  of  this  study  was  to  investigate  the 
interrelationships  of  these  variables  with  each  other 
and  with  performance  on  two  common  information 
processing  tasks.  Two  common  behavioral 
information  processing  tasks  were  used  to  sludv  four 
physiological  variables:  heart  rate,  skin  conductance, 
eye  movement,  and  cortical  evoked  response.  Heart 
rate  and  skin  conductance  were  studied  as  indicators 
of  autonomic  arousal.  The  cortical  evoked  potentials 
were  related  to  attentional  state  and  the  complexity 
of  stimuli  being  processed.  The  eye  movement  data 
were  used  in  the  interpretation  of  the  cortical  evoked 
potentials. 


Im  partll  tiliznlinn:  The  measures  of  arousal 

(heart  rate  anti  skin  conductance)  reflected,  in  a 
gross  sense,  the  degree  o|  subject  involvement  in  the 
task,  and  both  early  and  late  components  of  the 
cortical  evoked  response  varied  reliablv  with  task 
difficulty  and  performance.  This  was  geuerallv  true 
in  all  lour  experiments,  but  the  results  were  more 
clear  In  some  experiments  than  in  others.  It  wa- 
concluded  that  the  psvehoplty  siological  assessment- 
ol  attention  and  arousal  present  a  potennailv 
powerful  in  et  hodo  logv  for  as.se.-ing  human 
pt  riormain  e. 

Benefits :  Assessment  of  human  performance  has 
become  more  iliffit  nil  as  the  complexitv  of  mini- 
machine  systems  has  increased.  The  point  has  been 
reached  where  behavioral  research  must  step  bevond 
(lie  limits  imposed  liv  quantifying  behavior  in  terms 
of  motor  responses  only.  I’sychoph y siological 
assessment  of  the  internal  state  of  the  operator  show- 
promise  of  providing  the  tools  to  take  this  step.  Hv 
combining  behavioral  and  psyehophysiologieal 
assessments,  a  more  eomprehcnsiv  e  profile  of  human 
performance  should  emerge.  This  should  permit  a 
greater  understanding  of  the  conditions  under  which 
performance  deteriorates  and  should  point  to 
techniques  that  will  maximize  performance. 


Title:  C  os  t-Kffec  live  ness  Methodology  for  Aire  tv  w 
Training  Devices 

Description :  A  computer  methodology  and  the 
associated  software  were  developed  for  evaluating 
the  cost  and  training  effectiveness  of  devices  used  in 
aircrew  training  programs.  The  primary  purpose  of 
the  methodology  is  to  identify  the  most  cost-effective 
mix  of  training  devices  (including  aircraft, 
simulators,  and  part-task  trainers)  for  aircrew 
training  for  a  given  weapon  system.  The 
methodology  is  applicable  to  training  programs  at  all 
levels  for  both  existing  and  future  weapon  systems. 
The  computer  model  requires  input  data  on  training 
requirements  and  device  training  capabilities.  Some 
of  this  information  is  not  routinely  available,  and 
some  (e.g..  training  capability)  must  often  be 
estimated  in  the  absence  of  hard  data.  The  model 
uses  device  requirements  and  capabilities  data  to 
identify  all  mixes  of  devices  that  can  satisfy  training 
requirements;  it  then  uses  device  acquisition  and 
operating  costs  to  select  the  most  cost-effective  mixes 
of  devices  for  accomplishing  the  training  and  to 
compute  the  life-cycle  costs  of  these  sets  of  devices. 


Impact:  The  modfl  i.s  designed  Jo  rum bine  cost  data 
with  training  effectiveness  data  so  as  to  permit 
decisions  which  require  trade-offs  lirtnmi  I  lit*  two. 

I  hr  model  is  (a)  consistent  over  a  hroad  range  of 
training  situations,  (b)  flexible  in  accommodating 
differences  of  data  inputs  and  outputs.  (<•) 
sufficiently  comprehensive  to  permit  inelusion  of  a 
variety  of  significant  factors,  and  (d)  simple  to  use. 

II  cue  fits :  This  model  is  applicable  to  the  analysis  of 
both  existing  and  future  aircrew  training  systems.  I* 
also  contributes  to  the  analysis  of  many  aspects  of 
i  raining  rffertiv  eness  to  include  determination  of  (a) 
device  cosl-elfecti\ ene*s.  (b)  the  optimum  mix  of 

overul  devices,  and  (c)  the  optimum  deployment 
and  utili/atiou  strategies  lor  training  devices. 


Title:  Kvaiuation  of  Alternative  Heads -I  p  Display 
Svrnbologies  for  die  A  10  Airvruft 

th -scriphnn  In  conjunction  with  the  installation 
ol  an  inertial  navigation  system  (1\S)  in  the  \-10 
aircraft,  an  expansion  in  sv  m  hologv  was  proposed  hv 
the  \ erofitiiil ical  Svstenis  Division.  \-|0  Systems 
Program  Office  (\SD/\-l0  SPO)  for  the  \  - 1 0 
llcads-l  p  Displav  (III  ID.  The  new  symbology 
would  reflect  | hi  automated  navigational  capability 
of  the  INS  The  existing  II !  D  displays  airspeed  (  \/ 
S  f.  \  It  iff  ude  (  Ml),  roll  bar.  mil  setting  ( M  II.).  gun 
<  ros-.  (t  it !).  pilch,  pipper.  and  reticle.  I  he  new  III  I) 
would  add  magnetic  heading  ill),  vertical  velocity 
mdii  ator  ( V  \  I ) .  dive  angle  (DA),  total  velocity 
vector  (TAN),  destination  index  (Dl).  time  to 
destinaMor  (T).  and  distance  to  destination  (D).  The 
roll  bar  would  be  replaced  with  a  flightpath  ladder 
f I  PI.),  and  digital  pitch  would  be  replaced  with 
digital  dive  angle  in  the  new  III  I).  The  III  D 
operates  in  two  modes  —  flight  mode  (I1  VI)  for 
navigation  to  the  target  area  and  weapons  mode 
( W  VI )  for  weapons  delivery.  The  (tC.  and  reticle  are 
not  present  in  the  I  VI .  and  V  V  I  is  not  present  in  the 
W  V! .  The  follow  ing  three  issues  arose  concerning 
display  format  for  this  additional  symbology,  (a) 
Should  the  standard  sliding  stales  (tapes)  lor 
airspeed  and  altitude  be  replaced  with  digital  readout 
(odometer*)  in  order  to  provide  a  less  cluttered 
III  D ?  (b)  Should  the  flightpath  ladder  drift  with 
the  total  velocity  vector  in  order  to  portray  yaw  and 
to  reduce  the  requirement  for  shifting  eye  fixation  at 
critical  moments,  or  should  it  remain  stable  along  the 
central  axis  of  the  HI  D?  That  is.  should  the  I*  PI. 
drift  in  order  that  the  TV  V  anil  FIM.  arc  always 
aligned  with  the  flight  path  of  the  aircraft  ?  (c)  ^  hat 
declutter  options  should  he  employed  in  flight 


mode  and  weapons  mode?  NSD/V-IO  SPO  specified 
the  dcclutter  option-  to  he  tested,  flight  mode 
deelutter  \  (I'M  DA)  removed  T.  D.  II.  and  VVI 
Flight  mode  deelutter  B  (FMDB)  removed  only  II 
and  V  \  I .  Vi  capons  mode  dec 1  ut t «  r  \  (Vi  VI  D  VI 
removed  f  PI.  onlv  .  Vi  capons  mode  deelutter  B 
reinov  cd  I*  PI..  I.  a  ml  D.  file  I  PI.  i-  replaced  w  itfi  a 
roll  bar  when  deduttered.  A  -imulator  study  wa- 
designed  to  provide  preliminary  data  addressing 
these  issues  which  would  he  useful  in  planning  Might 
tests  for  a  more  comprehensive  resolution  of 
alternative  displays. 

Impart .  Alternative  cuufigurat ions  ol  III  D 
svmbology  were  found  to  significantly  allect 
performanee  in  navigation  and  wejpons  delivery 
tasks.  Various  needed  improvement-  in  such 
configurations  were  identified. 

lie n  c f  its :  I  lie  re.-nlts  of  this  research  were  utilized 
to  increase  the  effectiveness  of  \  -It)  flight  tests  of  the 
new  INS  and  III  l>  by  reducing  the  number  of 
sorties  required  for  evaluation.  In  addition,  this 
research  provided  a  broader  base  of  pilot  assessment 
of  proposed  symbology  than  would  hi*  available  by 
flight  tests  alone*. 


IitJe:  Kvaiuation  of  the  Transfer  of  Training  of  the 
Boom  Operator  Part- Task  Inline r 

Description :  i  he  purpose  of  this  research  was  to 
assess  the  training  effectiveness*  ol  the  Boom 
it-ralor  Part-Task  Trainer  (BOPTT).  an  air 
refueling  simulator.  Three  speeifie  ohjeetives  werr 
addressed:  (a)  to  determine  tin'  transfer  ot  (raining 
from  the  BOPTT  to  the  kT-ldo  aircraft  for  the 
l.omlial  f.rrw  Braining  School  (<  .<  IS)  hooitt 
operator  student.  (It)  to  evaluate  the  effectiveness  of 
the  BOl’TT  it)  till'  t.riilral  Might  Instructor  (iott  sc 
(CMC)  where  it  serves  as  the  sole  training  device, 
and  (c)  to  estimate  the  eost-av oidance  potential  ot 
the  BOl’TT  in  the  (U!TS  program. 

I  lilizution :  TOTS  students  trained  in  the  BOB  I  I 
required  significant!)  fewer  air  refueling  attempt. 
(,r»0  versus  VI)  to  reach  prolicicncy  in  the  k(.-I.Tv\ 
air  refueling  skills  than  did  students  trained  hy  the 
standard  syllabus.  In  boom  operations,  proeedttres. 
anti  communications,  all  BOPTT -trained  student.' 
were  equal  or  superior  to  the  students  in  the  standard 
syllabus.  I  sing  the  BOl’TT  as  a  surrogate  for  the 
KT-ld.'iA.  instructor  trainees  who  received  all 
training  sessions  in  the  BOl’TT  demonstrated 


I 


proficiency  equal  to  that  of  instructor  trainees  who 
received  all  training  in  the  K*E-13E>A  aircraft.  This 
1:1  training  transfer  ratio  afforded  hv  the  direct 
substitution  of  BOf’TT  training  for  aircraft  training 
in  training  experienced  hoont  operators  is  a  striking 
confirmation  of  device  effectiveness. 

benefits :  The  BOPTT  was  shown  to  be  an  efficient 
medium  for  training  all  aspects  of  boom  operator 
skills.  The  data  indicate  that  the  transfer  of  training 
value  from  the  BOPTT  to  the  aircraft  was  (>7%  in 
the  (E(ETS  program  and  1(10%  in  the  CT  1C.  program. 
I  he  findings  of  this  study  will  result  in  substantial 
changes  in  the  CCTS  and  (TIC  training  programs 
and  in  greatly  reduced  training  costs. 


Htie  :  f  i  A  Aim  raft  (Sentinel)  Might  Simulator  Follow- 
On  Operational  lest  and  ('.valuation 

Description .  AFHRI.  was  asked  to  assist  in  the  F- 
t A  Aircraft  Flight  Simulator  Follow-On  Operational 
lest  and  (Evaluation  (FOT<S  F)  relative  to  training 
capabilities,  psychological  fidelity,  and  human 
factors  engineering.  The  task?  were  to  assess  the 
psvchologieal  fidelity  of  the  flight  simulator  (FS). 
a-s-  --  the  capability  <  f  the  FS  to  train  the  required 
la-ks.  and  assess  the  human  factors  engineering  of  the 
i  ii  s  I  r  u  e  t  i  o  n  a  1  fea  t  it  res  —  spec  i  fica  1 1  y  .  the 
compatibility  between  the  FS  instructional  features 
(Instructors  Console  and  Radio  Aids  Console)  and 
(lie  operator's  functions. 

Import:  The  construction  of  the  FS  was  physically 
dictated  by  the  aircraft  cockpit.  As  such,  standards 
dictated  by  various  specifications  were  in  many  cases 
exempt.  Further,  the  nature  of  the  visual  system 
restricted  the  trainabilily  of  a  number  of  tasks.  The 
compatibility  between  the  FS  instructional  features 
anl  the  consoles  and  the  operator's  functions  were 
v  aluatrd.  and  those  features  which  would  enhance 
the  training  capability  of  the  FS  were  identified  for 
improvement.  Recommendations  were  made  for 
training  effectiveness  and  operational  effectiveness. 

benefits :  Incorporation  of  recommended  changes 
should  significantly  aid  in  further  development  and 
refinement  of  an  effective  F.-.1A  mission  crew 
training  program. 


Tide :  F-!.»A  Aircraft  ((Eagle)  (light  Simulator  Follow- 
on  Operational  Test  and  (Evaluation 

Description:  AFHRI,  was  asked  to  assist  in  the 
operational  evaluation  of  the  F-I.7A  aircraft  flight 
simulator  (FS)  in  the  operations,  training,  and 
logi-lies  area  The  effort  focused  on  evaluating  the 
fidelity  of  the  IS.  validating  computer  scoring 
algorithms,  anti  testing  the  effectiveness  of 
instructional  methodologies  used  in  pai  l -in  ission 
training.  In  addition,  potential  areas  for  enhancing 
existing  training  program-  were  identified.  I  lie 
Inslruetor  Operator  Station  was  evaluated.  th< 
training  effectiveness  of  the  FS  was  tested,  and  the 
life  eyrie  cost  of  the  C-I.'i  simulator  was  determined. 

Import:  By  allowing  dim  t  eomparison  of  the 
computer  scoring  system  with  instructor  pilot  (ID 
evaluation,  discrepancies  in  the  computer  scoring 
svstctn  were  identified  and  reeoni mendations  for 
improvement  made.  The  Human  Factors 
(Engineering  evaluation  of  the  instructor/operator 
station  (IOS)  highlighted  several  discrepancies,  and 
appropriate  recommendations  for  change  were 
made.  The  number  of  errors  made  by  the  IPs  on  the 
IOS  was  the  subject  of  a  separate  study  of  traiing 
effectiveness  which  led  to  the  generation  of  inputs 
for  use  in  future  IOS  design  and  training.  The  life- 
cycle  cost  study  provided  the  system  w  ith  cost  figures 
for  each  program  element  through  F >'01 . 

lie nejits :  The  benefits  accrued  from  the  findings 
and  recommendations  have  resulted  in  improved 
training  capabilities  with  reduced  inefficiencies  and 
inaccuracies  on  the  IOS.  Overall,  the  utility  of  the  FS 
has  been  enhanced  as  a  functional  devi.e  for 
operational  training. 


Title:  FY79  Simulator  for  Air-to-Air  (Eombat  (SAAfE) 
System  Refinement  and  (Enhancements 

Description:  In  the  continuing  process  of  refining 
the  Simulator  for  Air-to-Air  (Eombat  ( S  A  A  ( E ) 
through  management  of  the  maintenance  contract  by 
the  Air  Force  Human  Resources  Laboratory, 
significant  enhancements  affecting  operational 
training,  training  research,  and  maintainability  were 
incorporated.  The  Adaptive  Maneuvering  bogie 
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(AMI.)  program.  refined  to  provide  an  effective, 
computer-driven  adversary  in  both  1  vs.  I  and  2  vs.  I 
inodes,  has  been  expanded  to  include  a  canned, 
preprogrammed  target  aircraft  flightpath  program 
usable  for  both  operational  training  and  training 
research.  A  fourth  central  processing  unit  (Cl’l  ) 
plus  peripherals  has  been  intergrated  into  the 
operating  system  along  with  new  linkage  to  the  visual 
system.  Additionally,  the  cockpit  instrument  panel 
of  one  cockpit  was  updated  to  an  F4E  configuration 
with  the  inclusion  of  a  new  multiple  weapons  select 
panel.  Finally,  a  video  recorder  has  been  added  to 
the  remote  Air  Combat  Kngagement  Display 
( \CKI>)  as  a  further  instructional  aid. 

Imparl:  The  improved  AMI.  effectively  doubles  the 
training  utility  of  the  simulator  bv  providing 
instructional  capabilities  for  a  student  in  each 
cockpit  by  a  single  instructor  pilot  located  at  the 
instructor  operator  console.  The  preprogrammed 
target  aircraft,  a  new  research  capability,  permits  a 
comparative  evaluation  of  performance  of  a  number 
of  pilots  engaged  with  an  opponent  aircraft  operating 
in  constant,  predetermined  maneuvers.  The 
additional  F.l’l  and  visual  linkage  have  enhanced 
the  availability  of  the  simulator  for  training, 
expanded  its  use  for  off-line  program  development 
and  software  refinements  without  interference  with 
ongoing  training  programs,  and  established  a  stand¬ 
alone  visual  maintenance  capability  improving 
maintainability  of  the  system.  Integration  of  the 
multiple  weapons  select  panel,  replicating  that  of  the 
F-1K.  was  made  to  enforce  procedural  training  with 
actual  aircraft  switchology.  The  remote  video 
recorder  has  proven  to  be  an  effective  debriefing  tool 
which  provides  a  near  real-time  replay  capability  for 
review  of  engagements  by  aircrews  immediately 
upon  egressing  from  training  sessions. 

Benefits:  The  benefits  accrued  from  incorporating 
these  changes  have  resulted  in  improved 
maintainability  of  the  system,  enhanced  its 
availability  for  training,  reduced  the  possibility  of 
providing  negative  training  from  incorrect 
switchology.  and  enhanced  the  utility  of  the  device 
for  performing  flying  training  research 


Title:  1‘syehophysiologieal  Fflects  of  Training  in  a 
Full  Vision  Simulator 

Description:  T  he  purpose  of  this  study  was  to 
evaluate  the  psychophvsiological  dysfunctional 
responses  which  occur  in  the  Simulator  for  Air-fo- 
Air  F.omhat  (SAAF.)  and  to  explore  possible 


methods  to  reduce  these  reactions.  In  response  to  a 
series  of  reports  that  pilot  trainees  experienced 
dizziness,  fatigue,  nausea  and  vivid  v  isual  flashbacks 
of  experiences  after  intensive  training  in  the  SAAF.. 
the  Tactical  Air  Command  (TAC)  requested  that 
AFHKI,  study  this  problem.  An  interview  technique 
was  employed  to  gain  information  directly  from  the 
pilots.  The  group  of  pilots  studied  (N  ^48)  were  all 
fully -qualified  F4  pilots  who  were  being  trained  in 
the  TAC  Air  Combat  Kngagement  Simulator  (TAC 
ACES)  course  at  l.uke  AFB.  The  pilots  were 
interviewed  on  the  fourth  day  of  the  5-day  course, 
after  having  had  extensive  experience  in  the 
simulator.  The  results  of  the  interv  iew  revealed  that 
only  12.5%  of  the  pilots  were  symptom-free 
throughout  their  period  of  training  in  the  SA AC. 
The  most  frequently  reported  symptom  was  nausea, 
which  occurred  in  varying  degrees  in  7*). 20%  of  the 
pilots.  Other  symptoms,  in  order  of  frequency  were 
balance  problems.  (tO.42%  :  profuse  sweating. 
5  f .20%  :  sense  of  spinning.  54.12%  :  sense  of 
abnormal  maneuvers.  25.00%  :  and  other  (headache 
etc.).  22.02%  .  The  occurrence  of  symptoms  was  thus 
shown  in  a  large  proportion  of  the  pilot  group 
studied.  One  of  the  main  contributing  factors  for  this 
high  proportion  of  nausea  cases  was  considered  to  be 
the  frequent  use  of  the  freeze  mode  on  the  simulator 
particularly  during  high  risk  task  loading  in  air-to-air 
combat. 

Impact:  The  study  of  psychophvsiological 

dysfunctional  responses  in  the  SAAF.  lias  led  to 
several  modifications  of  the  instructional  procedures 
aimed  at  reducing  these  dysfunctional  responses. 
Further  studies  are  planned  to  include  the  nature  of 
the  dysfunctional  responses  so  as  to  make  further 
refinements  in  procedures. 

Benefits:  The  benefit  of  this  first  study  on 

psychophvsiological  disturbances  is  that  it  has 
produced  a  more  thorough  assessment  of  the 
problem  and  has  suggested  a  line  of  research  to  study 
the  problem. 


Title  :  S ini ula te d  A-IOFomhal  Knvimnmcnt 

Description  :  The  purpose  of  this  study  was  to  test 
the  feasibility  of  using  the  Advanced  Simulator  for 
Pilot  Training  (ASI’T)  in  training  pilots  for  combat 
in  a  simulated  hostile  environment.  It  has  been 
suggested  that  in  the  future,  complex  flight 
simulators  will  not  be  limited  simply  to  procedures 
and  instrument  training,  but  will  serve  the  much 


broader  nml  of  training  i  ombal-readv  pilots  in  tin* 
complex  ta^k  of  tactics  development  in  this  -*!  nil  \ . 
seven  \-|0  i  om bat-reudv  pilots  were  ev  aluated  <>n 
offensive  and  defensive  skills  while  living  through  a 
-iimilalrd  hostile  env mnmicril.  The  environment 
included  three  surface-to-air  missile  (S  \M  )  sites  ami 
four  anti-uircraft-artillerv  (  \  \  \  )  sites.  Ihe  offensi v  c 
task  uii>  to  destrov  a  tank  located  at  ramlom 
positions  along  a  roadway  .  I'.ach  pilot  was  briefed  on 
t  hr  environment  and  instructed  to  flv  into  the 
combat  area.  destrov  tin*  tank,  and  safeiv  egress  the 
area.  Ten  m  i."ion'  w  ere  How  n  in  tin*  morning  and  10 
in  the  afternoon  l»v  each  pilot.  The  results  showed 
that  there  was  a  elear  and  substantia)  learning  curve 
for  hot h  offensive  and  defensive  performance  in 
whieh  there  w  a  s  marked  i  in  p  ro  \  ern  en  t  in 
performance  with  repeated  trials. 

ImjHit  t:  Tlih  'tudv.  being  the  first  thorough.  real¬ 
time  simulation  ol  a  combat  scenario.  lias  served  in 
the  development  of  techniques  lor  laeties 
development.  >inn'  the  acquisition  ol  skills  lias  been 
-liown  to  develop  -o  elearlv.  the  studv  has  given 
impetus  to  eontinued  development  in  the  use  of  the 
\S|’|  tor  training  ‘ornhat  'kills.  II  this  sort  of 
training  is  extended  to  more  eomplex  and  elaborate 
scenarios.  net  benefits  eould  lie  verv  suh'taut ial 


lank. 


Title:  Additional  Impact  Analysis  for  the  1977 
Reevaluation  of  the  Weighted  Airman  Promotion 
System  (WAPS) 

Description:  In  response  to  a  Request  for 
Personnel  Research  (RPR  76-33),  "R evaluation  of 


H*'  n  r  I  its  :  The  hemTu  of  thi-  preliminary  'tudv  i- 
that  it  serves  to  establish  a  beginning  data  base  of 
simulation  lor  future  taetieal  dev  elopm  nit  'Indies. 


litle:  la  n  k  e  r/  I  ra  n  *»  port  Horn  her  (raining 
Hequiiv  merit 

l)rst  r ifihn  n  \  )  -y  ear  eont  rad  e thirl  in  support  ol 
anticipated  development  hv  the  \ir  I  raining 
Pomiuaud  (A  I  P )  ol  a  dual-track  Speciafi/n) 
l  ndergraduate  Pilot  Training  System  ISl  IMS) 
aeeoni pli'fied  the  following  tasks:  la)  identification 
of  lead-in  training'  for  M  ilitarv  \irlift  Pommand 
I  M  \P)  and  Strategic  \ir  Pommand  (S  \P)  aireraft 
to  whieh  undergraduate  pilot  training  (l  P  I  ) 
graduates  are  eurrentlv  assignable.  ( h )  ident ifieation 
ol  the  subset  ol  training  requirements  t«»  both  S  \P 
and  M  \  P .  («•)  development  of  wavs  ol  estimating  I  he 
training  heneiits  to  hr  derived  hv  M  \P  and  > \P 
from  t  a  n  ke  r /t  ra  n  s  po  r  t /ho  in  lie  r  (  I  IB)  lead-in 
training  on  common  tasks,  (d)  development  ol  a 
method  for  determining  the  gerieralizabilit y  of  any 
subset  of  T  I  B  tasks  to  t fie  entire  domain  ol  1TB 
training  tasks,  and  (e)  development  of  a  eamiidate 
I  I  B  performance  measurement  system  based  upon 
the  model  of  the  <!-.“>  \  Performartee  Measurement 
Svstem  wlrieh  is  not  undergoing  dev  elopm ent .  ITo* 
contract  effort  i'  now  complete.  I  he  results  •  *  I  thi' 
effort  vvill  srrve  as  a  basis  tor  subsequent  \  |( 
development  of  a  candidate  I  TB  training  syllabus, 

Im  i>a<  f .  This  work  extends  prev  ions  efforts  on  tin- 
part  of  \ TP.  as  well  as  of  M  VP  and  > \P.  in  the 
identific  ation  oi  those  tasks  which  would  lie  trained 
in  the  1TB  phase  of  a  Si  P  I  S. 

lir  nr  fits :  This  work  provides  a  logically  and 

empirieallv  roust  meted  data  base  upon  wliieh  to 
build  a  TIB  training  s\|lahiis.  The  approach 
developed  a  metluxl  which  addressed  the  extent  to 
whieh  specific  tasks  rail  he  expected  to  generalize 
(transfer)  to  other  tasks  not  covered  hv  lire  training 
program.  Ibis  information  ran  he  used  to  answer 
questions  concerning  cross-training  between  TI  B 
aircraft,  as  well  as  design  questions  regarding 
alternative  con  figurations  for  a  I’  IB  trainer  aireraft 
and  supporting  simulator.  A  candidate  performance 
measurement  svstem  incorporating  work  under 
progress  with  the  P-.V\  provides  relevant 
information  for  assessment  by  A  I  P  of  the  ITB 
aircrew  perforin anee. 


FORCE  STRUCTURE  AND  UTILIZATION 


(he  Factors  which  comprise  the  K-5/K-7  Weighted 
Airman  Promotion  System  (WAPS),"  a  multipart 
policy-capturing  study  was  initiated  in  March  19: 
During  Fiscal  Year  1979.  research  activities  focused 
upon  the  following  objectives:  (a)  to  analyze  the 
impact  on  minorities  and  women  when 


inrnMiHTitally  increasing  the  weight  on  the  Sf»eeialt\ 
Know  ledge  IVsl  (SKI)  factor,  (h)  t4»  auuly/.e  the 
impact  on  minorities  and  women  when 
incrementally  increasing  both  the  weight  on  the 
SK  I  factor  and  the  weight  on  the  Promotion  Fim«»-> 
Examination  (IM  h)  factor  si  in  ultaneously.  and  (c) 
for  those  Air  Force  Specialty  dories  which  require  no 
SKT  .  lo  analyze  the  impact  on  in  in o n I  ie- ,  women, 
and  junior  airmen  when  incrementally  increasing 
the  weight  on  the  I’ I  k  factor.  All  planned  work  in 
support  of  RI’R  7 tl-i.i  has  heen  completed. 

ImpactU  tilizulion  ■  The  VI  A  I'S  was  dev  eloped  hv 
A  I  URL  in  1^68  to  provide  a  com  puteri/ed 
promotion  system  that  was  both  equitable  and  v  isible 
to  airmen.  Since  the  implementation  of  ^  VPS  in 
l(I.P.  airmen  in  grades  F-l  through  K-7  have  l»een 
selceted  I  o  r  promotion  based  on  their 
rn at hernat icall \  weighted  composite  promotion 
scores  consisting  of  six  promotion  selection  factor-. 
The  weights  and  factors  have  heen  periodical!' 
reevaluated  hy  AkllRI  ,nd  the  research  outcomes 
used  to  recommend  anv  improvements  to  the 
existing  VI  A  PS.  The  results  of  the  aualv  sis  w  ill  assure 
\ir  koree  managers  that  no  proposed  modifications 
to  Vi  \  PS  w  ill  have  an  adverse  effect  upon  women  or 
minorities. 

Hen  e  fits :  Hie  results  of  the  impact  analvsis 
reported  here  contribute  to  the  overall  improvement 
and  cffcctiv eness  of  the  current  \A  \  PS.  The  benefits 
of  ^  \  PS  are  in  turn,  more  object iv ilv  in  promotion 
selections,  better  understanding  and  aeeeptanee  of 
the  system  liy  airmen,  higher  morale,  increased 
effii  icnev  .  and  increased  (pialitv  of  selectees. 


Till*  :  Assessment  of  Safety  Training  Priorities  for  Air 
Force  Jobs 

Description:  From  field  inspections  and  accident 
data  reviews,  the  Air  Force  Inspection  and  Safelv 
Tenter  provides  input  lo  technical  training  course 
designers  to  insure  that  job  safety -related  factors  are 
covered  in  sufficient  depth  during  training.  This 
research  project  is  designed  to  studv  the  feasibility  of 
developing  and  implementing  a  standardized 
methodology  for  prioritizing  job  tasks  along  such 
dimensions  as  hazard,  frequency  of  accidents,  and 
other  safety  -related  aspects,  which  could  then  be 
used  lo  more  accurately  determine  the  safely 
training  for  specific  jobs. 


Impwt/I  t :  I  i  z  a  l  i  o  ri  :  information  from  a 

standardized  methodology  assessing  safety  training 
needs  would  he  used  in  eoneert  with  other 
occupational  aualv  se-  data  hv  technical  training 
course  designers  and  managers  to  insure  the  maxima! 
productive  utilization  of  training  time.  Application 
of  this  methodology  across  tasks  and  jobs  could  also 
he  used  hy  Air  Force  management  in  projecting  time 
loss  hy  accident 

He nefits :  Implementation  of  this  methodology 
should  result  in  improved  job  safety,  avoidance  of 
personal  injuries,  reduction  of  equipment  time  loss, 
and  reduction  in  material  loss  due  to  on-the-|oii 
accidents. 


lidc  :  Design  ol  a  National  Skills  Market  Model  for  Air 
Force  knlisted  Personnel 

I )  e  s  <  r  i  p  1 1  n  n  :  Detailed  specifications  were 
developed  in  this  study  lo  describe  feasible  options 
«v ailalde  for  designing  and  implementing  a  N ational 
.■skills  Market  Model  —  j  n  empirically  based 
forecasting  model  of  economic  activity  in  the 
industrial  and  occupational  labor  markets  in  which 
the  Air  l  on  e  competes  for  its  labor.  Kssentially.  the 
model  formulated  in  this  study  consists  of  three  basic 
analytic  components  which,  in  combination, 
produce  detailed  forecasts  of  national  labor  market 
conditions,  and  generate  projections  of  the  total 
accession  and  retention  of  Air  Force  enlisted 
personnel.  The  basic  analytic  components  include  a 
non-military  labor  module,  a  population  projection 
module,  and  an  aeeession/retention  rate  forecasting 
module.  F.acli  of  these  components  is  then 
subdivided  into  one  or  more  analytic  elements  w  h it'll 
address  distinct  aspects  of  the  general  issue  examined 
in  the  analytic  component.  Results  ol  this  effort  are 
documented  in  AFIIRI.-TK-T’I-M.  Design  of  a 
National  Sltills  Market  Model  Jor  Hr  l  one 
Unlisted  Personnel,  published  in  September  DITW. 

Im  piirl/l  tilization :  A  significant  feature  of  the 
proposed  modular  structure  of  this  model  is  that  it 
permits  the  initial  development  and  subsequent 
utilization  of  each  analytic  element  of  the  model  lo 
he  performed  relatively  independently,  without 
coin  prom  ising  the  analytic  properties  of  the 
remaining  elements.  Results  of  this  research  will  he 
used  in  the  .subsequent  development  of  an  Air  Force 


National  Skills  Market  Model.  Its  basic  purpose  will 
lie  to  proside  \ i r  Force  poliev  makers  and  decision¬ 
makers  with  the  capability  to  determine  the  impart 
oil  accession'  and  retentions  resulting  from  the 
interaction  u(  \  i  r  force  policies  and  economic, 
demongraphic  and  environmental  conditions. 

Hi  nt  fit\  In  addition  to  projecting  accession  and 
retention  rales,  the  model  will  generate  information 
about  tile  national  labor  market  useful  to.  and  usable 
In  \ir  force  poliev -makers  and  decision-makers  in 
the  lerlormance  of  their  assigned  functional 
respc  u'ihlllltes. 


lid** :  Development  and  Nalidadon  of  Measures  to 
V«sess  the  (.orrelatcs  of  Successful  Performance  in 
the  HI  VW  (  an  er  Flekl 

I) c  sr  r iptm n  : ■  The  purposes  of  this  research  were  to 
(a)  select  and/or  dev  flop  screening  methodologies  to 
measure  the  personal,  psychological,  altitudinal,  and 
motivational  correlates  of  successful  performance  in 
the  8IXXX  career  field,  (b)  field  test  and  evaluate 
methodologies  on  a  representative  sample  of  HI  XXX 
accessions,  and  (c)  assess  the  effectiveness  of  the 
screening  techniques  and  furnish  recommendations 
for  improving  the  quality  of  the  security  police  force. 
Results  are  reported  in  A  I'll  R  l.-TR -77-38. 
/Ve lim  inary  Development  and  I'ulidntion  of  a 
Screening  Technique  fur  Entry  into  the 
Security  Police  Career  Field  ■  AFH  R  l.-TR -77-70. 
Screening  for  Entry  into  the  Security  Police 
Career  Field;  and  A  F'll  R  l.-TR  -70-lb.  Correlates 
of  Successful  On-the-Joh  Performance  in  the 
Security  Police  (hr  Force  Specialty  Code 
HI  XXX)  Career  Field.  This  research  effort  was 
initiated  as  a  result  of  a  Request  for  Personnel 
Research  (RPR  7  f-l  VI  from  the  Air  Force  Security 
Police  Directorate. 

Impact/I  tilization :  The  KIXXX  career  field, 
which  comprises  about  3. ’>.000  persons 
(approximately  b"i>  of  the  total  enlisted  force)  has 
had  an  unacceptable  number  of  first-term  airmen 
who  become  noneffeclive  and  who  subsequently  are 
either  retrained  or  separated  from  the  Air  Force. 
This  is  a  substantial  loss  of  money  and  manpower 
resources  which  might  be  minimized  through  a  more 
refined  selection  anil  classification  system.  The 
results  of  this  research  effort  form  the  basis  for 
selecting  those  personnel  who  have  the  maximum 
likelihood  of  becoming  successful  security 
policemen.  Due  to  the  decrease  in  attrition  in  recent 


months,  this  screening  methodology  is  being  held  in 
abeyance  at  present.  However,  if  an  increase  in 
attrition  should  occur,  operational  use  of  a  selection 
composite  developed  from  this  research  project 
would  be  considered. 

Henefits:  Hosts  associated  with  retraining  and 
separation  of  personnel  who  are  noneffective 
security  policemen  could  be  reduced  by  identifying 
those  not  likely  to  succeed  in  this  career  field. 
Additionally .  there  are  intangible  savings  associated 
with  having  a  security  police  force  composed  of 
maximally  effective  personnel  to  insure  operational 
readiness. 


Title:  Development  of  a  Methodology  to  Assess 
Psychological  Stress  and  its  impact  in  the  /Air 
Combat  Environment 

Description :  As  a  result  of  a  request  from  the 
Tactical  Air  Command,  a  joint  effort  evolved 
between  A  FUR  I.  and  the  l  SAF  School  of 
Aerospace  Medicine  to  develop  a  methodology  (a)  to 
identify  which  aspects  of  a  combat  fighter  mission 
produce  the  psychological  experience  of  stress,  (b)  to 
assess  the  level  of  stress  generated  by  various  aspects 
of  a  fighter  mission,  and  (e)  to  evaluate  the  impact  of 
stress  on  performance  in  air  combat. 

\  methodology  was  developed  and  a  trial 
administration  was  conducted  using  subjects  having 
extensive  Southeast  Asia  combat  experience.  Rased 
on  the  results  of  the  trial  administration,  it  would 
appear  that  the  methodology  is  valid  and  capable  of 
identifying  empirical  relationships  between 
psychological  stress  and  performance  in  air  combat. 
As  a  follow-up  to  the  trial  study,  data  have  been 
coll  ••■ted  from  .>(1(1  additional  Southeast  Asia  combat 
experienced  pilots.  Analyses  of  these  data  are  in 
progress  with  preliminary  indications  of  significant 
differences  associated  with  aircraft  type  and  aircrew 
experience.  The  results  are  reported  in  A  FH  R  l.-TR  - 
78-3.  Methodology  to  Assess  Psychological 
Stress  and  its  Impact  in  the  Air  Combat 
F  n  cironm  ent. 

Impact/l  tilizalion:  Empirical  evidence  generated 
by  this  methodology  should  be  of  use  to  operational 
managers  and  strategists,  within  the  training 
environment,  and  within  the  selection  and 
classification  system  for  rated  personnel.  Increased 
knowledge  of  the  stress  associated  with  fighter 
missions  and  of  the  stress  management  of  fighter 
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pilots  Hill  alloH  more  precision  in  estimating 
personnel  requirements  and  in  maximizing  the 
effective  utilization  of  combat  aircreu  resources. 
Additionally,  in  combination  with  other  on-going 
research  efforts,  it  is  possible  that  a  stress 
management  factor  might  be  introduced  into  the 
pilot  screening  program,  either  at  the  point  of  initial 
selection,  or  a  differentiation  into  cockpit 
assignments.  Finally  a  spin-off  benefit  is  the 
generation  of  a  data  base  relevant  to  the  maximum 
number  of  fighter  missions  that  a  single  pilot  could 
effectively  fly  against  heavilv  defended  targets  in  a  2- 
week  period.  This  information  is  important  with 
regard  to  "sortie  surge"  maximums.  F.fforts  are 
underway  to  extend  the  application  of  this 
methodology  to  a  data  base  with  combat  experienced 
personnel  and  to  establish  a  complementary  data 
base  from  the  simulated  combat  environment. 

lie  nrfits :  The  focus  of  this  project  was  towards 
enhancing  the  selection,  training,  and  management 
of  combat  aircrew  resources,  thereby  increasing  the 
operational  readiness  of  the  Air  Force. 


Title  :  Development  of  an  Organizational  Assessment 
Package  (OAF) 

I)  e  s  i  r  if)  t  in  n  :  This  research  involved  the 
development  of  an  Organizational  Assessment 
Package  (O  \P)  for  use  by  the  \ir  Force  Leadership 
and  Management  Development  Center  (I.MIM!)  In 
identifying  organizational  problem  areas.  The  OAP 
was  developed  on  a  contingency  model  of 
organizational  effectiveness  which  considered 
organizational  effectiveness  to  be  a  function  of  the 
manager,  the  situational  environment,  and  the 
criteria  of  success.  The  results  are  reported  in 
A  F  II  K  l.-TK  -TH-'fd.  O  rganizalio  mil  Survey 
A  s  v  c  s  \  m  e  n  t  l‘  a  r  h  a  g  e  for  Air  I'  <>  r  <  e 

Organizations,  anil  A  F  II  H  I.  -  T  K -7V- 1  t) . 
Situational  Farlur  Identification  in  Air  Force 
Organizations,  and  A  F  1 1  R  I .  -  T  R  - 7  'I  - 1  (> . 
Organizational  Assessment  Indices  of 
h.ffec  tire  ness. 

Impact/I  tilization :  The  OAP  is  used  by  I.MIM 
travel  team  members  as  their  prime  instrument  to 
guide  their  organizational  intervention  program. 
OAPs  are  administered  to  work  groups  at 
installations  throughout  the  Air  Force:  work  group 
effectiveness  factor  indices  are  generated  for  each 
work  group;  and  problem  areas  are  identified  by 
I.MIM!  consultants.  The  OAP  became  I.MIMi's 
operational  instrument  in  September  I '178. 


Benefits :  I.MIM!  has  reported  that  at  least  three 
other  surveys  that  were  to  be  developed  by  other 
agencies  were  cancelled  and  the  OAP  used  instead 
I.MIM!  travel  team  members  report  that  their 
problem  identification  function  and  overall 
efficiency  have  been  vastly  improved  bv  using  the 
OAP.  A  data  base  developed  from  data  collected  on 
the  OAP  has  provided  I.MIM!  with  normative  data 
which  provide  a  means  of  comparing  different 
groups  (for  example,  different  bases  or  commands 
and  different  \ ir  F  orec  Special!  v  ( .odes)  and  a  giy  on 
group  with  an  Air  Forte  or  command  norm.  The 
OAP  provides  a  mean.-  of  testing  the  effectiveness  of 
\  arious  inters  cut  ion  strategies  used  bv  I  ,M  IM !  travel 
teams. 


'fitle :  F!vaiuation  of  Aptitude  Requirements  of  Air 
Force  Jobs 

l)esi  ription:  In  an  all-volunteer  recruiting 

environment,  particularly  with  a  descreasing 
manpower  goal  projected  for  the  1'JKlt‘s.  it  is  critical 
to  insure  that  minimal  aptitude  requirements  not  be 
overstated  and  that  high  level  talent  be  allocated  to 
jobs  having  the  greatest  difficulties.  A  methodology 
has  been  developed  to  assess  the  aptitude 
requirements  of  Air  Force  jobs  based  on  the 
relationship  between  the  relative  aptitude 
requirements  and  the  relative  learning  difficulty  of 
job  tasks  I  sing  a  benchmark  task  approach  across 
specialties,  this  methodology  has  been  applied  to  jobs 
in  the  Flectronies.  Mechanical,  and  Genera!  aptitude 
areas.  Additionally,  methods  to  assess  the  clerical 
aptitude  requirements  of  Air  Force  jobs  have  been 
developed  and  are  currently  being  evaluated. 

Impai  tH  tilization:  Results  from  this  research 
regarding  the  realignment  of  aptitude  requirements 
for  approximately  l(M)  Air  Force  jobs  have  already 
been  provided  to  the  Air  Force  Manpower  and 
Personnel  t!enter.  Additional  data  from  70  more 
jobs  will  be  available  shortly.  The  findings  of  this 
project  are  also  being  implemented  through  the 
computerized  job-offer  system  used  by  the  Air  Force 
••eruitiiig  Service.  A  complete  implementation 
package,  including  a  comprehensive  impact  analysis, 
is  currently  being  developed. 

Benefits:  There  arc  three  significant  areas  where 
cost  avoidance  should  be  achieved  as  a  result  of  this 
research.  Gonlingcncy  plans  for  talent  shortages  will 
be  available  as  a  product  of  this  effort.  These  plans 
will  enable  the  Air  Force  to  specifically  plan  for 
talent  shortages  in  any  specific  specialty  or  across  all 


specialties,  Another  proilmt  Hill  lie  a  mure 
defensible  position  for  aptitude  requirement-  in  the 
ease  of  court  actions.  The  present  s\-tcm.  which 
excludes  manv  individuals  from  entering  Sir  force 
jobs  based  on  a  "cut-off  aptitude  score.''  lias  no 
objective  data  to  support  its  use.  This  research  will 
provide  data  on  the  learning  load  requirements  for 
each  job.  Another  product  will  lie  an  improved 
match-up  of  Air  Force  talent  and  job  requirements. 
Improving  this  match  of  talent  with  requirements 
can  have  effects  on  job  attitude,  retention,  recruiting, 
and  training. 


Title:  Expansion  of  the  Pereon-Job-Match  (PJM) 
S  vs  te  m 

Description:  The  Person-Job-M  atch  system  was 
first  developed  in  1*176  for  the  purpose  of  classifying 
applicants  into  guaranteed  Air  Force  jobs  in  the  pre- 
enlistment  environment.  A  bout  60%  of  all 
applications  are  currently  classified  by  the  PJM 
system.  During  FY  70.  the  I'JM  system  was 
expanded  to  allow  optimal  classification  of  the 
remaining  10%  of  the  recruits  who  are  currently 
classified  during  Basic  Military  Training  (BMT). 
The  augmented  version  of  the  I’JM  system  will 
classify  the  BMT  trainees  in  a  single  weekly  batch 
computer  run.  Some  research  has  been  completed  on 
basic  algorithms  which  use  a  recursive,  self- 
correcting  forecasting  technique.  The  dynamic 
prediction  models  for  enlisted  skill  payoffs  were 
developed  through  a  contract  with  Scientific 
Systems.  Inc.,  together  with  an  adaptive  Kalman 
filter  prediction  algorithm  which  automatically 
changes  its  prediction  parameters  under  changing 
conditions.  The  technical  report.  A  FH  R  1,-TR  -76-2*1, 
Pre  -F.  nlistm  en  t  Person-Job  Match  System. 
gives  a  detailed  presentation  regarding  Kalman 
Filtering  and  State  Forecasting. 

tmpact/V tilization:  The  PJM  System  will  be  used 
by  Air  Training  Command  Air  Force  Recruiting 
Service  and  by  the  Air  Force  Manpower  and 
Personnel  Center  to  optimally  classify  trainees  into 
Air  Force  jobs. 

Henefils:  The  PJM  System  optimizes  person-job 
assignments  which,  in  turn,  enhances  job  satisfaction, 
productivity,  effectiveness  and  morale.  The  net 
result  is  a  more  effective  work  force  and  improved 
operational  readiness.  It  is  the  basis  of  the  Air  Force 
Guaranteed  Enlistment  Program  (GTEP)  and 
greatly  contributes  to  a  favorable  Air  Force 
recruiting  image. 


Title :  Methods  for  Collecting  and  Analyzing  Task 
\nal\sLs  I  la  ta 

Descripho  n  :  This  eflort  w  as  aim ed  at  determining 
methods  to  deline  standardized  task  analysis 
niethodologv  for  use  in  the  Air  force  technical 
training  environment.  T  he  contract  was  to  identify 
methods  for  collecting  and  analvzing  task  analytic 
data  that  are  simple  to  use.  reliable,  valid,  and 
practical,  for  standardized  application  by 
Instructional  Sv-teins  Development  staff-  at  Air 
Training  Command  training  centers.  A  task  analysis 
handbook  was  developed  outlining  procedures  that 
provide  a  degree  of  uniformity  and  quality  control  at 
various  training  centers  and  schools.  To  accomplish 
these  objectives,  a  survev  of  current  task  analyses 
procedures  was  conducted,  an  experimental  task 
aiialvsis  handbook  was  developed,  and  the  handbook 
was  field  tested  at  selected  training  centers,  revised, 
and  finalized. 

Im  par  t/l  tilization:  The  Task  Analysis  Handbook 
aids  in  the  identification  of  objective  information 
regarding  essential  skills  and  knowledges  which  the 
trainee  must  learn.  It  also  holds  the  potential  for 
increasing  training  efficiency  w  hile  reducing  training 
costs. 


Title:  Productivity  in  Security  Police  Squadrons 

Description:  The  purpose  of  this  research  is  to 
develop  a  methodology  for  measuring  changes  in  the 
productivity  of  security  police  squadrons  that  result 
from  squadron  reorganization.  Productivity 
measures  will  include  both  subjective  criteria,  such 
as  supervisor  ratings,  and  objective  criteria 
developed  in  conjunction  with  job  experts  from  the 
security  police  career  field.  Measures  will  be 
collected  from  bases  matched  for  similarity  in  all 
respects  except  squadron  organization.  Data  will  be 
collected  repeatedly  from  these  bases  in  a  time-one. 
time-two  format.  Policy  capturing/specifying 
techniques  will  be  used  to  identify  the  significant 
characteristics  of  effective  security  police  squadrons. 
This  research  was  initialed  at  the  request  of  the 
Chief,  Security  Police  in  Europe. 

Im pact/V tilization:  The  results  of  this  research 
will  be  used  in  decisions  regarding  the  organizational 
structure  of  security  police  squadrons  in  Europe. 
Additionally,  the  technologies  developed  will  be 
applicable  for  use  in  other  AF'SCs.  as  well  as  security 
police  squadrons,  throughout  the  Air  Force. 
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Benefits:  Results  from  this  research  will  enhance  the 
productivity  of  security  police  squadrons  in  Kura  pc. 
provide  a  method  for  self-evaluation  of  unit 
effectiveness,  and  provide  Air  Force  Inspector 
General  personnel  with  improved  methods  for 
evaluating  security  police  performance. 


Title:  Recruiting  Resource  and  Goal  Allocation 
Modeling  Research 

Description:  This  research  effort  has  resulted  in 
two  different  optimization  models  for  use  by  the  Air 
Force  Recruiting  Service.  Roth  were  developed  by 
AFHRI.  in  response  to  a  formal  Request  for 
Personnel  Research  to  examine  the  possibility  of 
optimally  allocating  the  resources  under  the  control 
of  Air  Force  Recruiting  Service.  One  of  the  models 
was  developed  in-house  with  the  cooperation  of  Or. 
Charles  Beswick  of  the  I  niversity  of  South  Carolina. 
This  model  is  a  modification  of  a  sales  force 
allocation  algorithm  which  uses  a  non-linear  market 
response  function  and  a  dynamic  programming 
allocation  routine  to  allocate  recruiting  effort.  The 
other  model,  developed  under  contract  to 
OR  I  N  CON  Corporation  of  l.ajolla.  California,  uses  a 
Markov  probability  process  to  determine  the  optimal 
use  of  advertising  funds  and  the  allocation  of 
recruiting  quotas.  Roth  of  these  models  will  be 
documented  in  future  technical  reports. 

Im  pact/ 1  tilization:  Headquarters  Air  Force 
Recruiting  Service  has  requested  the  development  of 
these  models  and  w  ill  be  the  ultimate  user  of  the  final 
operational  version  of  the  decision  tools  developed 
under  this  research  effort. 

Benefits:  The  use  of  decision  tools  in  the  difficult 
decision  areas  of  resource  utilization  should  result  in 
better  informed  and  therefore  more  effective  use  of 
the  resources  under  the  control  of  the  Air  Force 
Recruiting  Service  and  enable  this  Service  to  achieve 
personnel  input  goals.  Increased  attention  to  optimal 
use  of  resources  should  greatly  improve  the  decision¬ 
making  process  of  Air  Force  Recruiting  Service 
managers. 


Title:  Rexearrh  and  Development  of  an  Air  Force 
Occupational  Research  Data  Bank 

Description:  The  objective  of  this  effort  is  to 

establish  an  Air  Force  Occupational  Research  Data 
Rank  that  will  be  concerned  with  the  collection. 


analysis,  maintenance,  ready  retrieval,  and  reporting 
of  a  wide  variety  of  current  and  historical 
information  describing  all  airmen  and  officer 
occupations.  Data  elements  from  widely  dispersed 
data  bases  will  be  integrated  and  related  to  each  other 
in  a  systematic  fashion.  In  addition  to  information 
about  personnel  resources,  information  about  the 
correlates,  antecedents,  and  consequences  of  selected 
occupational  requirement  variables  will  be  included 
in  the  integrated  data  base. 

Im  pact/ 1  tilization:  In  addition  to  providing  a 
quick  response  capability  when  information  is 
requested  from  the  many  data  bases  at  AFHRI..  the 
Occupational  Research  Data  Rank  will  provide  new 
information  about  important  policy  issues  that  have 
not  been  properly  addressed  before,  simply  because 
the  data  from  one  subsystem  (e.g..  percent  fill  in  an 
organization)  have  never  been  adequately  related  to 
data  from  another  subsystem  (e.g..  accidents). 


Title:  Retraining  and  Transferability  of  Skills 

Description:  Air  Force  managers  rely  heavily  on 
the  capability  to  retrain  enlistees  from  one 
occupational  specialty  to  another  in  coping  with  the 
continuing  problem  of  manning  shortages  and 
overages  in  career  fields.  A  comprehensive 
evaluation  of  the  operational  retraining  program  and 
of  the  progress  and  performance  of  the  10.000  to 
15.000  airmen  who  change  specialties  annually  is 
underway.  A  recently  completed  study  of 
performance  in  basic  technical  training  suggests  that 
retrainee  achievements  are  comparable  and  in  most 
schools  superior  to  non-prior  serviee  enlistees  (non- 
retrainees)  with  equivalent  aptitudes.  Additional 
analyses  indicated  that  enlistees  characterized  by 
high  military  tenure,  career  airman  status,  and  prior 
experience  in  a  specially  with  the  same  aptitude 
index  are  good  candidates  for  retraining.  These  study 
results,  as  well  as  an  evaluation  of  the  viability  of  the 
current  10-point  entry  aptitude  waiver  policy,  will 
soon  be  documented  in  AFHRI.  technical  reports. 

Other  on-going  and  planned  retraining  research 
includes  identification  of  the  types  of  reassignment 
actions  which  arc  operating  smoothly  and  those 
which  arc  generating  adjustment  problems.  Skill 
upgrading,  career  progression,  and  reenlistmcnt  rates 
arc  of  interest.  A  major  focus  is  transferability  of 
skills  and  knowledges  and  the  case  of  movement 
between  specialties. 


Im  pact/!  tilization  :  Current  research  will  provide 
managers  of  the  Airman  Retraining  Program  and 
related  programs,  such  as  Palace  Balance  and 
CAREERS.  with  an  empirical  basis  for  evaluating 
and  effecting  policy  decisions. 

Benefits:  Improved  retrainee  selection  and 

assignment  procedures  can  he  expected  to  stimulate 
participation  in  the  program,  favorably  impact 
reenlistment  rates,  and  increase  the  productivity  and 
satisfaction  of  airmen  in  second  specialties. 
Assignments  which  optimize  skills  transfer  will  result 
in  dollar  savings  through  lowered  attrition  rates  as 
well  as  reductions  in  training  time  required  for 
retrained  personnel  to  achieve  proficiency  in  their 
new  occupations. 


Title :  Taxonomv  and  Assessment  of  Productivity 
(.  rite  ria 

Description:  The  purposes  of  this  research  are  to 
(a)  review  current  and  past  efforts  to  define/measure 
productivity,  (h)  classify  those  measures  with  respect 
to  practicality,  cost-effectiveness,  and  relevance  to 
the  Air  Force,  (c)  systematize  the  major  classes  of 


factors  which  have  been  shown  to  impact  oil 
productivity,  and  (d)  develop  a  conceptual 
framework,  based  on  empirical  data,  that  can  serve  as 
a  guide  to  future  research  and  evaluation  efforts.  An 
extensive  field  survey  of  government  and  civilian 
agencies  with  responsibility  for  research,  evaluation, 
and/or  measurement  of  productivity  is  currentlv 
underway. 

/  m  par  l/t' tilization:  The  development  of  a 
classification  scheme  for  productivity  criteria  across 
Air  Force  jobs  will  provide  researchers  and  managers 
with  a  useful  tool  for  designing  and  evaluating 
changes  in  organizational  factors  related  to 
productivity.  Additionallv .  the  identification  of  and 
communication  with  various  agencies  involved  with 
productivity  research  have  fostered  a  positive 
interaction  among  those  agencies. 

Benefits:  Results  from  this  study  will  he  used  to 
plan  and  conduct  a  comprehensive  approach  to  the 
study  and  measurement  of  productivity,  increase  the 
generalizability  of  results  from  studies  on 
productivity,  improve  management  of  Air  Force 
resources,  and  increase  the  readiness  and 
effectiveness  of  Air  Force  personnel. 


PERSONNEL  AND  TRAINING  FACTORS  IN  ADVANCED  SYSTEMS 


Title:  Demonstration  of  an  Expert  Estimate 
Technique  to  Predict  Human  Resources  and 
Logistics  Requirements 

Description:  A  demonstration  of  a  technique  for 
predicting  human  resources  (HR)  and  logistics 
requirements  associated  with  modern  weapon 
systems  (WS)  has  been  performed.  This  technique  is 
applicable  during  the  very  early  stages  of  WS  design, 
making  it  possible  for  logistics  and  HR  factors  to 
influence  WS  design. 

Im pact/lJ tilization:  These  research  results  have 
provided  the  final  laboratory  verification  required  of 
the  technique.  The  Expert  Estimate  technique  is  now 
regarded  as  being  a  sufficiently  tested  design  tool  for 
the  Air  F'orce  Acquisition  Logistics  Division 
(AFAI.D)  use.  AFALD's  use  of  this  technique  will 
allow  for  a  greater  consideration  of  logistics  and  HR 
factors.  Reduced  HR  and  logistics  costs  throughout 
the  WS  life  should  result. 


Benefits:  It  has  been  determined  that  the  cost  of 
ownership  accounts  for  up  to  80%  of  weapon  system 
life  cycle  costs  (C-130  data).  It  has  been  estimated 
that  logistics  and  HR  account  for  over  half  of  the 
ownership  rosts.  This  technique  allows  logistics  and 
HR  factors  to  impact  WS  design  so  that  logistics  and 
HR  costs  should  be  significantly  reduced. 


Title:  Design  Methodology  for  Human  Resource  and 
Cost  Factors  in  Weapon  System  Acquisition 

Description:  A  methodology  for  using  human 

resources  and  cost  factors  in  weapon  system  design 
and  planning  studies  was  developed  and 
demonstrated.  The  methodology,  titled  coordinated 
human  resource  technology  (CHRT),  integrates  five 
technologies  of  maintenance  manpower  modeling, 
instructional  system  development  (training),  job 
guide  development  (technical  data),  system 
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ownership  costing,  and  human  resources  in  design 
trade-offs.  The  methodology  operates  from  a  single, 
consolidated  data  base  (CDB).  The  methodology  is 
applicable  throughout  weapon  system  acquisition 
and  provides  for  (a)  the  early  assessment  of  system 
design  and  support  plan  impact  on  human  resources, 
logistics,  and  cost:  and  (b)  the  development  of  a 
mutually  supportive  and  coordinated  training 
program  and  technical  manual  set.  The 
demonstration  was  accomplished  using  data  from  the 
conceptual,  prototype,  and  projected  minimum 
engineering  development  phases  of  the  advanced 
medium  short  takeoff  and  landing  (STOl.)  transport 
(  \MST)  aircraft  program. 

Impart/ I  tilizalion  :  The  Itepartment  of  Defense  is 
requiring  greater  involvement  of  manpower,  cost 
and  logistics  factors  in  weapon  system  design  and 
development  studies  (l)ol)  Directives  5000.1  and 
5000.2).  The  methodology  reported  here  will 
contribute  to  the  accomplishment  of  this  objective.  A 
specific  tryout  and  refinement  of  the  methodology  is 
planned  for  FY  HO  to  FY  82  in  coordination  with  the 
Deputy  for  Avionics  Control.  Aeronautical  Systems 
Division. 

Benefits:  A  significant  step  has  been  taken  toward 
achieving  the  DoD  goal  of  comprehensive  inclusion 
of  manpower,  cost  and  logistics  factors  in  weapon 
system  design  and  planning.  The  benefits  will  be  in 
terms  of  reduced  cost  of  ownership  and  increased 
operational  readiness.  Data  from  this  study  indicate 
that  cost  reductions  of  10%  to  20%  and  readiness 
increases  of  5%  to  10%  can  be  expected.  More 
definitive  cost  and  readiness  data  will  be  determined 
in  the  follow-on  FY  80  to  82  effort. 


Title:  Develop  Models  of  Maintenance  Resources 
Interaction 

Description.  The  accurate  forecasting  of 
maintenance  manpower  requirements  to  support  a 
weapon  system  is  greatly  influenced  by  the  status  of 
other  major  resources  (e.g..  spares  and  support 
equipment).  The  computer  simulation,  previously 
developed  at  A  FURL  (the  maintenance  manpower 
model,  utilizing  the  Logistics  Composite  Model 
(I.GOM ))  is  jsed  by  the  Air  Force  to  determine  the 
manpower  requirements  for  weapon  systems. 
Currently.  I.COM  requires  that  the  other  resources 
be  held  constant.  LCOM  would  be  more  valuable  if 
models  of  the  maintenance  resources  interaction 
were  developed.  Determination  of  the  LCOM 
sensitivity  to  the  resources  interaction  for  a  weapon 


system  ( F - 1 5 )  under  peacetime  and  wartime  surge 
environments  will  provide  the  basis  for  the 
development  of  models  of  the  interactions.  The 
outcome  will  be  models  of  the  interaction  between 
manpower,  spares,  and  support  equipment  required 
to  support  weapon  system  operations  and 
maintenance. 

Im par  t/U tilizalion  :  The  results  of  this  study  will 
be  used  to  provide  a  means  for  more  accurately 
forecasting  manpower  along  with  the  requirements 
for  spares  and  support  equipment.  The  results  also 
have  the  potential  to  provide  the  Air  Force  with  a 
means  for  determining  readiness.  The  users  of  the 
end  products  will  be  all  Air  F'orce  LCOM  users, 
working  with  both  developing  and  operational 
weapon  systems. 

Benefits:  The  models  of  Maintenance  Resources 
Interaction  is  of  use  for  both  developing  and 
operational  aircraft  and  is  an  invaluable  tool  for 
determining  resources  and  for  trade-off  decisions 
concerning  manpower,  spares,  and  support 
equipment.  In  addition,  this  methodology  provides 
the  Air  Force  with  a  means  for  dealing  with  readiness 
issues. 


Tide:  Handbook  for  Selection  of  Format  Options  for 
Procurement  of  Technical  Data 

Description:  Significant  progress  has  been  made  in 
recent  years  to  improve  Air  Force  technical  data  for 
maintenance.  Application  of  job  guide  manuals,  logic 
tree  troubleshooting  aids,  functionally  oriented 
maintenance  manuals,  and  other  types  of  improved 
technical  data  have  significant  potential  for 
improving  Air  Force  maintenance.  However, 
implementation  of  these  data  is  handicapped  by  the 
fact  that  many  technical  data  managers  are  not 
sufficiently  familiar  with  the  various  options  and  the 
applications  for  which  each  type  of  data  are 
appropriate.  Available  information  on  the  various 
types  of  data  is  widely  scattered  in  technical  reports 
and  other  documentation  which  is  not  readily 
available  A  handbook  describing  the  types  of 
improved  technical  data  that  are  available  and 
providing  guidance  for  the  selection  of  technical  data 
options  for  selected  applications  will  be  very  helpful 
in  overcoming  this  problem.  The  handbook 
developed  under  contract  contains  information 
about  what  technical  order  formats  are  available, 
how  to  determine  which  format  to  select,  and  how  to 
procure  and  manage  the  development  of  the 
technical  orders.  Guidelines  are  also  included  for 
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( 


implementation  <if  the  technical  orders  in  an 
operational  environment. 

I  tilizatian:  The  handbook  is  expected  to  become 
the  basic  source  of  information  for  technical  order 
managers  in  the  system  program  offices  in  the  Air 
Force  Systems  L.ommand.  the  Air  Force  Logistics 
l.ommand.  and  the  major  operational  commands. 
VI  hen  available  to  technical  order  managers,  the 
handbook  should  have  a  favorable  impact  on  the 
technical  order  procurement  process. 

Benefits:  The  information  contained  in  the 
handbook  will  help  the  technical  order  managers  do 
a  better  job  of  procuring  better  technical  orders.  The 
procurement  process  w  ill  become  more  efficient,  the 
technical  orders  will  be  more  appropriate  for  the 
intended  user,  and  the  maintenance  accomplished 
with  the  technical  orders  will  be  more  efficient  due 
to  better  data. 


Title  :  life  Cvrie  Cost  Estimation  of  Simulated  vets  us 
Actual  Cquipment  Maintenance  Training  forthe  F-16 
Avionics  Intermediate  Shop 

Description:  At  the  request  of  the  F-16  System 
Program  Office  (SPO).  AFIIRI.  performed  an 
analy  sis  and  comparison  of  the  life  cycle  costs  of  F-l(> 
avionics  intermediate  level  training  when  conducted 
on  simulated  versus  actual  aircraft  and  maintenance 
equipment.  This  effort  was  conducted  in  two  phases. 
Phase  I  was  a  preliminary  Life  Cycle  Cost  (LOO) 
analysis  which  indicated  that  simulated  equipment 
would  save  approximately  50%  over  actual  aircraft 
equipment  when  used  for  training.  Rased  on  these 
findings.  Phase  II  was  accomplished  to  provide  a 
more  detailed  analysis  of  the  cost  of  the  two  training 
device  alternatives.  This  analysis  concluded  that 
there  can  be  a  cost  savings  in  training  if  simulated 
equipment  is  used  in  lieu  of  actual  equipment  as  a 
training  device.  LOO  of  a  simulated  device  was 
estimated  to  be  58.6%  of  that  of  actual  equipment 
life  cycle  costs.  No  study  was  made  regarding  the 
actual  training  effectiveness  of  either  type  of  device. 
Consequently,  such  evaluation  is  necessary  prior  to 
any  final  statement  regarding  the  relative  actual  cost 
of  the  two  types  of  equipment. 

/ m  par  t/ll tilizatian  :  The  results  of  this  effort  have 
been  reported  to  the  F-16  SPO.  This  methodology 
can  he  used  to  help  determine  the  specific  factors  and 
costs  involved  in  the  methodology  developed.  The 
methodology  that  has  been  developed  also  provides  a 


critical  cost  estimation  technique  that  can  be  used  to 
help  make  procurement  decisions  regarding 
maintenance  training  devices. 


Tide:  Personnel  Availability  Mtidel 

Description:  The  Personnel  Availability  Model 
(PAM)  is  a  computerized  user-interactive  model, 
personnel  data  bank,  and  application  methodology 
for  estimating  the  future  availability  of  Air  Force 
maintenance  personnel  on  the  basis  of  historical 
career  transition  activity  as  recorded  in  the  I  niforrn 
Airman  Record  (l  AR).  The  data  bank  contains  a 
selection  of  data  elements  from  the  167.5/1 676  I  AR 
files  for  65.000  airmen  assigned  to  15  Air  Force 
Specially  Lodes  (AF.S(’s).  The  model  represents 
career  transition  activity  within  I’SAF  by  a  series  of 
Markov  processes,  each  depictings  suhpopulation  of 
airmen,  with  states  defined  by  years  of  service  and 
pavgrade.  State  transition  probabilities  are  calculated 
on  the  basis  of  actual  transition  activity  data 
contained  in  the  l  AR.  Subpopulations  may  either 
be  defined  on  an  a  priori  basis,  such  as  by  A  FSL 
designation,  or  analytically  established  by  applying  a 
regression  analysis  technique  called  Logit  Analysis. 
This  technique  identifies  subpopulations  consisting 
of  personnel  exhibiting  similar  career  transition 
behavior  and  describes  them  in  terms  of  individual 
attribute  data  contained  in  the  L  A  R  .  It  also  prov  ides 
a  basis  for  assessing  potential  personnel  policy 
imparts. 

Im  part/ 1  'tilizatian:  The  PA  M  ,  its  data  bank,  and 
application  methodology  were  to  be  applied  in 
support  of  the  Advanced  Medium  STOI.  Transport 
(AMST)  program.  Due  to  an  interruption  in  that 
program,  data  were  not  available  to  identify  the 
AMST  maintenance  personnel  requirement.  The 
PAM  was  applied,  however,  to  produce  sample 
estimates  of  the  future  availability  of  AFSLs 
presumed  to  be  typical  of  AMST  requirements. 
Their  selection  was  predicated  on  their  past/present 
assignment  to  similar  systems. 

Benefits:  The  PAM  provides  a  capability  to  guide 
weapon  system  development  in  avoiding  the 
establishment  of  support  personnel  requirements 
which  are  likely  to  be  difficult  or  impossible  to  fulfill 
at  a  future  point  in  time  when  the  system  becomes 
operational.  It  allows  design  and  support  planning  to 
occur  in  fuller  consideration  of  potential  impacts  on 
system  ownership  requirements. 
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Title:  Specification  for  the  Accomplishment  of 
Maintenance  Task  identification  and  Analysis  fur 
Technical  Older  Development 

Description:  Substantial  research  has  indicated 
that  a  maintenance  task  identification  and  analysis  is 
a  vital  part  of  any  technical  order  development 
program.  Known  benefits  include  more  thorough, 
detailed,  and  accurate  data.  However,  no 
specification  was  available  to  specify  a  task 
identification  and  analysis  for  technical  order 
development  programs.  The  specification  developed 
under  contract  incorporates  the  best  of  known  task 
identification  and  analysis  procedures. 
Recommended  procedures  include  the  positive 
identification  of  every  task  to  be  done  on  every 
component  and  the  maintenance  level  where  the 
work  is  to  be  accomplished.  The  determination  of 
whether  the  task  is  to  be  included  in  the  technical 
order,  the  specific  test  equipment  required  for  every 
task,  and  the  detailed  task  steps  are  also  covered  in 
the  specification.  Included  also  are  user  description 
requirements.  This  specifies  that  the  intended  user 
be  identified  in  as  much  detail  as  possible.  A 
handbook  is  also  available  to  guide  the  contractor  in 
producing  the  analysis. 

V  tilization:  The  specification  and  handbook  are 
expected  to  become  contractual  requirements  for 
future  technical  order  programs.  The  guidance 
contained  in  both  documents  will  be  used  by  the 
contractor  to  accomplish  the  analysis  and  by  the  Air 
Force  manager  in  the  procuring  agency  to  oversee 
the  program. 

Benefits :  The  availability  and  use  of  the 

specification  and  handbook  will  result  in  higher 
quality  technical  orders  being  procured.  The 
development  of  a  task  identification  and  analysis  will 
result  in  technical  orders  that  are  more  complete  and 
have  fewer  errors  and  that  more  nearly  meet  the 
informational  needs  of  the  users.  Better  technical 
orders  should  permit  improved  maintenance  with 
fewer  errors,  thus  resulting  in  more  efficient  and  less 
costly  maintenance. 


Title:  Specification  for  the  Development  of  Logic 
Tree  Troubleshooting  Aids 

Description:  Previous  research  accomplished  at 
AFHR1.  indicated  that  logic  tree  troubleshooting 
aids  (I.TTAs)  were  very  effective  in  assisting  the 
technician  in  isolating  failed  components.  Although 
the  logic  tree  format  has  been  around  for  several 


years,  no  specification  was  available  to  guide  the 
development  process.  In  addition,  the  LTTAs  used 
by  AFHRL  in  the  experiment  contained  additional 
information  to  make  the  aids  more  usable  by  less 
experienced  technicians.  This  additional 
information,  called  enrichment,  was  new  to  the  logic 
tree  concept.  A  specification  for  the  development  of 
LTTAs  has  been  developed  by  AFHRL  under 
contract.  This  specification  provides  total  guidance 
to  the  contractor  on  how  to  develop  the 
troubleshooting  action  trees.  The  specification 
provides  guidance  on  failure  mode  analysis,  on 
format,  and  on  enrichment  possibilities. 

U tilization:  The  specification  will  be  used  by 

technical  order  managers  in  the  System  Program 
Offices  (SPOs)  as  a  contractual  document  when  the 
logic  tree  form  of  troubleshooting  aids  is  required. 
When  identified  in  the  contractual  statement  of 
work,  the  specification  will  be  used  by  the  contractor 
to  develop  the  aids  and  by  the  Air  Force  manager  to 
manage  the  development  of  the  logic  trees. 

Benefits:  The  availability  of  the  specification  will 
permit  quality  logic  tree  troubleshooting  aids  to  be 
developed.  When  properly  utilized,  logic  trees  can 
reduce  the  number  of  spare  parts  used,  decrease  the 
number  of  mistakes  made,  and  can  permit  less 
experienced  technicians  to  perform  difficult 
troubleshooting  tasks.  Logic  trees  thus  have  the 
potential  of  improving  maintenance  performance 
while  reducing  maintenance  costs. 


Tide :  Weapon  System  Design  and  Need  for  Human 
Resources  Data 

Description:  The  Air  Force  Weapon  System  (WS) 
design  process  was  analyzed  and  outlined  in  order  to 
identify  the  WS  designer's  needs  for  human 
resources  (HR)  and  logistics  data.  One  hundred 
sixty-four  interviews  were  accomplished  with  WS 
designers  from  nine  aerospace  and  engine 
manufacturing  companies.  The  need  for  HR  and 
logistics  data  to  support  the  many  tradeoff  studies 
conducted  by  project  engineers,  logisticians,  and 
reliability  and  maintainability  people  was  identified. 
Also,  existing  Air  Force  data  systems  were  outlined. 
Next,  the  WS  designer's  needs  for  HR  and  logistics 
data  were  matched  against  the  existing  Air  Force 
data  systems  in  order  to  identify  any  deficiencies  in 
the  data  systems.  Finally,  the  detailed  requirements 
for  a  logistics  and  HR  data  base,  termed  Unified  Data 
Base  (11  l)B),  were  outlined. 
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Impact/Utilization .-  The  documentation  resulting 
from  this  effort  will  provide  WS  designers  with  a 
quick  reference  as  to  the  available  HR  and  logistics 
data  in  the  numerous  Air  Force  data  systems.  Also, 
the  most  commonly  investigated  data  parameters 
and  the  Air  Force  data  systems  which  list  their  values 
are  indicated.  Finally,  the  FDB  outlined  verified  the 
feasibility  of  developing  a  I'DB  under  a  follow-on 
exploratory  development  effort.  To  a  significant 
degree,  this  study  prompted  the  issuance  of  a 
Program  Management  directive  for  the  development 
of  a  I'DB  by  the  Air  Force  Logistics  Command 


Benefits:  The  information  contained  in  the 
documentation  will  help  WS  designers  determine 
and  prioritize  the  trade-off  studies  which  they  should 
perform,  and  thus  help  assure  that  HR  and  logistics 
factors  are  addressed  during  the  WS  design  process  as 
early  as  possible.  Also,  the  follow-on  I’DB 
development  effort  will  provide  timely,  available, 
consistent,  accurate,  and  traceable  HR  and  logistics 
data  to  WS  designers,  managers,  logisticians,  and 
human  factors  scientists  within  the  aerospace 
companies,  the  Aeronautical  Systems  Division.  Air 
Force  Logistics  Command  and  the  Air  Force  Test 
and  F.valuation  Center. 


PERSONNEL  SELECTION  AND  RETENTION 


Tide:  Pereeptual-Motor  Ability  Measurement 

Description:  For  over  two  decades,  the  Air  Force 
has  relied  almost  exclusively  upon  measures  taken 
from  traditional  paper-and-pencil  tests  for  the 
selection  of  both  enlisted  personnel  and  officers. 
This  has  been  a  valid  and  generally  effective 
procedure,  but  one  which  has  failed  to  utilize 
measures  that  numerous  studies,  in  particular  those 
conducted  by  the  Army  Air  Force  during  World  War 
II.  have  shown  may  make  significant  contributions 
to  personnel  selection.  These  measures,  which  are 
grouped  under  the  term  "perceptual-motor.’’ 
typically  require  the  use  of  some  apparatus  other 
than  a  simple  test  booklet  and  answer  sheet  and  in 
many  cases  must  be  individually  administered.  These 
two  aspects  have  generally  limited  the  application  of 
perceptual-motor  tests,  because  of  the  difficulties 
traditionally  associated  with  the  calibration  and 
maintenance  apparatus  tests  and  the  need  to  test 
large  numbers  of  individuals  for  the  military 
services.  File  development  of  solid-stale  electronic 
components  and  the  increasing  availability  of  low- 
cost  computer  terminals  have  eliminated  the 
majority  of  the  difficulties  formerly  associated  with 
tlie  measurement  ot  perceptual-motor  abilities  and 
have  brought  about  a  renewed  interest  in  the  use  of 
such  measures  in  the  selection  of  Air  Force 
personnel.  I  In*  use  of  two  tests  of  psvrhnmolor 
coordination  lor  the  selection  of  pilot  trainees  is  now 
being  evaluated:  over  2..300  individuals  from  the 
Reserve  Officers'  Training  Corps.  Air  Force 
Academy,  and  Officer  Training  School  have  been 
tested.  This  testing  program  will  continue  and 
eventually  other  tests  of  perceptual-motor  abilities 
will  he  developed  and  evaluated.  In  addition  to 
measures  of  basic  perceptual-motor  abilities, 
measures  of  integrated  anilities  are  also  being 
developed.  These  measures  are  derived  from 
computer-controlled  monitoring  of  performance  in 
flight  simulators  and  are  indicative  of  how  quickly 
and  how  well  an  individual  can  learn  to  perform  a 
task  which  demands  high  integration  of  a  number  of 
pcreeptual-motor  abilities. 


li  tilizatin n  :  Tests  of  perceptual-motor  abilities 
may  be  used  by  recruiting  and  assignment  agencies 
and  Ivy  Air  Training  Command  for  the  selection  and 
classification  of  both  enlisted  personnel  and  officers. 

Benefits:  The  use  of  tests  of  perceptual-motor 

abilities  w  ill  result  in  the  reduction  of  attrition  from 
training  with  a  corresponding  reduction  in  training 

costs. 


Two-Hand  Coordination  Test  Csing  Portable 
Psvchomotor  Test  Device. 


Title:  Advanced  Researeh  on  Adaptive  Testing 
systems 

Description:  The  policy  of  the  Air  Force  has  been 
to  develop  uniform  standardized  aptitude  tests  for  all 
enlistment  applicants.  These  tests  must  be  as  short  as 
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[n»  Mbl»*.  ;ii  i  'ir'1*'  :il  'll  f>l  ;in<i  \  .iliii  for 

li  .pmnt:  J'hI  pcr)*»rin »•  itMitm  W  hcr»  »*\»rv 

Jpp!u;ml  for  « *  n  j  i  n  i  «*  it  *  nnj-t  ini'i«r  ril  llir 

-atri»  lr-l.  romi'roaihc-.  \\\  lr-l  i|t  -ign  .irr  ‘inr-<iir\ 
.inti  «i<Tiir ;ir\  o|  inr.isinrmrnl  is  i r n 1 1 1 * *« j  l«»  ;i  i;nw( 
«*i  <  iii'il  l  !ir  nnvtt  of  I  fir  ahilit*  -pn  :  r  i  ;in  I  hi-  inraib 
th;il  mi I'.cl.jxxi |irjt hoi  of  a;i  Jpplham  »-  im<r»  !rk  *l\  to 
uiriir  m  ihc  ahililN  r^i'iio  which  arc  <oj|>h1*  rh« 
of  first  tnrasurrmrnl.  Ml.ipliv**  Irsting  i<  a 
•'IraN-io  tor  tailoring  tin*  number  ami  diffirullv  of 
lost  (jur>lioiiv  during  Icsl  aifr.i iui-tr.»tu*n.  I  hr  a<atiia! 
[•rrsr ulal ion  of  ituns  reflect*  .ippiicaiil  n»spofiM*K. 
ami  ?  fir  >\-tcin  avoids  ihc  o  r  r n  I  a  I  i  o  n  of 
m.ippmpriuN  items.  The  topic  is  bring  >tu<iie»l 
through  a  rum  hina! ton  of  ilirorrltral  s i if*  illation  and 
!i\r  te>ting  of  subjects.  Research  to  investigate 
n mu #*mmis  a>i»rrts  of  .nluptiv  c  testing  nimlcls  and 
'importing  ihmrx  has  been  mill plcte<f  and  additional 
efforts  ar**  umlcrwav.  Stiiilie-  in  ihi>  field  have  h  ad 
lo  a  journal  publication  and  to  thrrr  jiajicrs 
presented  a‘  prole-simial  meetings.  A  FUR!.  ».-  a 
recognized  Iradrr  in  this  firld  with  Or.  Malcolm  .1. 
K  re  receiving  ifir  Mr  Force  A -.-ociation  s  Dan 
Rerkanl  award  for  his  research. 

I  hi izatinri:  Adaptive  testing  will  hr  used  hy  the 
Mr  fon»  Recruiting  Service  and  hy  the  \rniv 
Military  KuUstmcm  Ftov  essing  '  .nmmaml. 


Tide:  Armed  Services  Vocational  \ptftiide  Battery 
Siihtestand  Composite  Revisions 

fh'st  ri/ition:  \  validation  study  of  the  eurreni 
\  rm<  d  Srrv  iers  \oeational  \ptitudr  Battery 
\  \S\  \H)  stablest.*  and  composite*  for  predicting  \  jr 
loro  trrfinirai  training  rnur-e  grade  is  being 
arroinpli^lnd.  Mialyses  already  romplrtrd  have 
deinonsl ruled  the  ahsolute  and  relative  values  of  the 
le*i  measures  and  have  aided  in  determining  which 
siihie-t  should  he  dropped  from  or  replaced  in  future 
\>\  \  H  forms.  On  the  basis  of  \ir  force  ami  other 
srrvier  validations,  changes  wen*  made  in  \S\  AH 
Form*  8.  V.  and  ID.  These  changes  should  increase 
tfir  validitv  and  reliability  of  the  hattrry.  These 
analv>es  fiavr  identified  optimal  suhtrsts  and  suhtest 
weights  for  Mr  Foree  composites.  Implemented 
change*  will  enhance  battery  validitv  and  insure 
fairness  for  sex  and  rare  subgroups. 

Inifxn  t/(  tilizatnm :  \SV  \  R  is  used  for  the  initiaf 
screening  and  classification  of  all  noil-prior  service 
applicants.  In  this  context,  im  pro  venients  in 
predictive  validity  could  enhance  the  utility  of  the 
applicant  pool  and  tend  to  place  more  easily 
trainable  personnel  in  each  vocational  area,  resulting 
in  substantial  training  costs  savings  in  each  of  the 
different  armed  services. 


Iidc  :  I h- vc  lopme ill  a n<l  AalMlalion  of  Armed  Services 
AocuUoiial  Battery 


!l,\i  rijilimi :  Tln<  i  ouliiuiinu  I'rnprani  jir<>\  i  (<-- 
j  ft <•  A  i  i  I  »rn'  with  i- 0 1 1  uni  fill  *'  1 1 ,- *■  i '  v  , 
in. lriiiiir.it.  for  llir  selection  .i ml  a-signm i  n  I  u! 
.«ii  iiii-fi.  In  r<--|>« > n in  llir  nri  il  lur  ;i  |uint-M'i  v  i- i - 
1 1-  - 1 .  tin-  V  nil i-il  ,'-i-ri  iri--  \  it.'.il  mu al  \  |ii  1 1 1||||- 
Hiiil.-rs  (  \  r-  \  \IM  Ira.  '.irrn  i->ii  i--nrl\  in  ml  1 1  n-ii 
anil  r x  (i;i mi*’il  t<i  Jirn1-  ulr  a  -iii^I  -  I1.1M*  rv  vxhirli  i  an 
In-  rlli-rliw  l\  niili/nl  1-1  all  arini-il  -iri  In-..  UMHI 
run  ti  n  in-.  In  irr  u-  a.  llir  li-ail  I  ilmralurx  in  <  I !  I  - 
,-jfnrl  \  alulaliun  ilala  -m  riirrrnl  \  li  >nlili->l- 

.1  n I i  i  uni ini.ili-'  liiivr  lin-ii  iinaly/t-il  lur  1.1  \ir  1  urn- 
li-i’iinii  .i I  Iraimng  i  inirn-  rlu>trr>  llata  mi  -l->  ul 
llii’ir.  main  o(  \slinli  mrtuilrd  .rparali'  >i*\  and  rai  i- 
valiilitirs.  ivrri-  .rill  In  llir  Mi*pul\  \s.|.lanl 
Si-i  rrlarv  nf  I )rli-mr  ml  21  Oi  loln-r  I*/.  •  In  assiMl  llir 
.-rrri-ta-x  of  llrlrnir  <  i-nrral  tiounn-l  in  rmirvnur 
i,.nai  -li  ii-miliiliH  nl  I  Im-  lr-l'.  Olln-r  vali_dil>  >lnilir- 
oii  -  ul'ji-r  i  i-  i-nli-rinp  tin-  \ir  lurrr  in  I ‘I,  -  anil  I^H 
liav iirru  ruin |il<-t<-rl.  I  li #- si*  ilala  urn-  unalvzril  in 
wav.  wliii  h  a.sistnl  Imili  in  iiirnlitv  infi  rnntrnt  area. 
!nr  I  nrms  J(.  V.  ami  lOnflln-  liallrrv  and  in  rrvi.iiifX 
\  ir  1  urn-  i-uiii |io.ili*..  I  In*  imai  vi-rsiun  nl  ll'*‘  nrw 
\S\  Ml  Inrun  Uo  In-  di-sijinali-d  d.  and  Hi)  liavr 
Im-i-ii  drv rlo|ii-d  and  arrrj'ird  !>y  all  mililarv  .rr\  n  I- - 
fur  i 111 (ilr-tn <-uta( ion .  Thi-  ciirri-nt  v  rr.iun  will  run.i.l 
„|  six  parallel  lr-l  forms  (ralln-r  than  ihri-i-  a.  in  priur 
\S\  \  If  versions)  and  a  lonp-r  Vrinrd  I  nrrrs 
l^ualifii  aliun  Ti-sl  (  AH,)D  romjmsiir  fur  si-rvirr 
srli-rl iun .  Tlii-. i-  rhanj'i's  wil!  ri-suil  in  lnghrr 
ri-liahilil \  and  validitv  as  wrll  as  ninrli  less 
romjirmnise  in  eomparison  will)  past  VS\  \H  lesl 
forms. 

Im  imrt/l  lilizalion  \SV  Mi  will  lie  revised 
M-riudirallv  in  arrordance  with  \ir  Foree 
aiions  S.'i-<>  and  .'l.">-fi.  I'.mphasis  roiilimie.  to  In- 
di reeled  Inward  making  seleetinu  more  etferlive 
l  lie  \s \  Mi  is  used  l>v  the  Mr  Koree  HeeruiliiifJ 
.serviee  and  in  all  major  eorn mauds.  The  ASA  All  is 
a ] Ml  iiM-d  in  a  joint  service  h i Jill  selinol  lesliii}' 
program  and  is  the  selection  and  classification 
instrument  used  Ivy  all  armed  services. 

lirnr/its:  Through  the  use  ol  the  ASA  All.  the 
armed  services  have  been  able  to  select  and 
effectively  utilize  a  ipialily  enlisted  foree.  Although 
there  is  no  direct  method  lo  compute  the  total  dollar 
impact  of  the  ASA  AH  in  terms  of  reduced  training 
attrition  and  in  increased  operational  effect  is  eness.  if 
one  assumes  that  the  increased  efficiency  in  the  Inro* 
management  Yields  a  modest  increase  in  prnduetiY  ity 
of  out y  .">%  in  the  Air  Koree.  the  annual  gain  is 
equivalent  lo  about  .1000  workyears.  which  would 
translate  into  an  Air  Koree  value  of  approximately 
.ill  million  dollars. 


Title:  Me  VI- lupine  111  and  Validation  of  Officer 
Selection  Tests 

Mrseripfion:  A  new  form  ol  the  Air  Koree  Officer 
(Qualification  Test  (AIO(QT-O)  is  scheduled  for 
development  in  I  Oft  I .  Major  revisions  are  not 
planned:  however,  based  upon  inputs  from  pilot  and 


ii a v  igalor  selection  research,  restructuring  of  certain 
composites  mat  he  effected.  An  extensive  validation 
study  using  Officer  Training  School  students  is 
underway.  Students  will  he  tracked  through  OTS. 
technical  schools,  and  their  first  tear  in  a  joh  setting. 
At  a  later  date,  personnel  from  the  Air  Force 
Academy  and  Reserve  Officers  Training  Corps  will 
fie  tracked  in  a  similar  manner. 

I  tilizalion:  The  selection  procedures  developed 
will  he  used  hv  Air  Training  Com mand. 

Henejils:  The  Air  Force  will  benefit  from  this 
research  program  through  lower  officer  training 
attrition  and  improvement  in  the  quality  of  the 
offieer  force. 


Title :  I)e  ve  lupine  nt  of  an  Appraisal  System  forllSAF 
Civilian  IVrsonnel 

Description  :  The  development  of  a  comprehensive 
management  system  for  encouraging  excellence  in 
joh  performance  of  Air  Force  civilian  employees  is 
underway.  The  system  has  four  major  modules:  fa) 
Senior  Kxecutive  Service  Appraisal,  (b)  Merit  Pay 
Appraisal,  (e)  job  Performance  Appraisal,  and  (d) 
Promotion  Potential  Appraisal.  The  procedures  for 
distributing  bonuses  to  senior  executives  are  based 
on  job  performance  evaluations  and  have  been 
developed  and  made  operational  as  of  1  Oct  7').  A 
similar  system  for  evaluating  general  managers  (CS- 
I  .1  to  GS-I.r>)  and  distributing  merit  pay  among  these 
managers  is  under  development.  Non-executives  or 
general  managers  will  be  evaluated  bv  the  job 
performance  module  which  is  also  under 
development.  This  system  includes  a  module  for 
each  element  indicated  above.  The  job  performance 
module  pivots  upon  a  supervisor-worker  agreement 
of  the  dominant  elements,  or  tasks,  of  the  job  upon 
which  ratings  should  he  rendered  and  includes  a 
system  establishing  the  priority  of  those  tasks  and 
standardizing  the  ratings  across  positions.  The 
promotion  potential  model,  also  underdevelopment, 
will  include  biographical,  experimental,  aptitudinal. 
and  performance  based  variables  which  will  be 
collected  across  the  full  spectrum  of  Air  Force 
employees.  F.xpcrts  in  each  vocational  area  will 
define  the  variables  critical  to  promotion  in  that  area 
through  a  policy-capturing  exercise.  Although  the 
requirement  for  the  job  performance  and  promotion 
efforts  predate  the  Civil  Service  Reform  Act  of  1978 
by  2  years,  it  is  believed  that  the  evolved  systems  are 
precisely  in  accord  with  the  objectives  of  the  act. 

I  m  part/I!  tilizatin  n :  The  results  of  this  effort  will 
be  used  for  all  civilian  employees  throughout  the  Air 
Force.  It  will  be  the  basis  lor  selection  for  promotion, 
special  assignments,  training,  award  of  special  pay, 
and  other  personnel  actions.  This  system  will  permit 
management  and  career  development  of  the  civilian 
workforce  based  on  the  results  of  experimental 
studies.  It  is  believed  that,  over  time,  this  system  wil 
be  seen  as  responsive  to  the  needs  of  both 
management  and  employees. 


litic :  Screening  of  Prospective  Air  Traffic  <  milnd 
Operators 

/description.  The  Air  Force  <  .niiiiiiuiio  aliou- 
Coinmand  f  1 observed  that  an  rx<  i->mi  e  number  ul 
individuals  either  tail  in  Air  I  raflo  l  ontroi 
Operator  Training,  or  fail  to  achieve  and  maintain 
field  certification  after  completion  nl  training  and 
assignment  to  an  operational  unit.  The  problem  ol 
Air  Traffic  Control  Operator  selection  ha-  been 
investigated  at  length  by  the  Federal  Aviation 
Agencv.  and  techniques  developed  bv  that  agellcv 
mav  be  applicable  to  the  Air  Force.  Initial 
investigations  w  ill  center  around  improv  ed  screening 
using  the  composite  scores  obtained  from  the  Armed 
Services  Vocational  Aptitude  Battery,  l  ater,  new 
testing  procedures  will  be  evaluated,  including  the 
FA  A  selection  tests  and  com puter-ad m inistered 
simulations  of  the  Air  Traffic  Control  operator  s 
tasks.  |)ata  obtained  from  test  adminisl rations  w  ill  he 
compared  to  performance  during  training  and  later 
In  the  field  setting  to  determine  optimal  selection 
procedures. 

D  tilizalion:  The  selection  procedures  developed 
will  be  used  by  the  Air  Forre  Communications 
Command. 

Benefits:  Cue  of  the  improved  selection  procedure- 
will  reduce  the  attrition  from  training  and  from  the 
field,  with  an  associated  cost  savings.  Results  may 
also  provide  for  the  identification  of  individuals  who 
not  only  will  succeed  in  training  hut  also  will  prove 
better  able  to  perform  Air  Traffic  Control  operator 
duties,  thus  improving  the  quality  of  the  force. 


Title:  Sek’ctioit  6>r  Navigator  Training 

Description:  The  Undergraduate  Navigator 

I  raining  program  has  experienced  an  unusually  high 
attrition  rate  in  recent  years.  Despite  a  major 
reconfiguration  of  the  Air  Force  Officer  Qualifying 
Test  (AFOQT)  Navigator-Technical  composite, 
additional  research  is  needed  to  investigate  the 
problem.  The  current  research  approach  centers 
around  the  development  of  an  experimental  job 
sample  task  based  upon  several  elementary 
navigation  concepts,  design  of  an  experimental 
procedures  learning  task,  revision  of  two  abstract 
reasoning  tests  which  have  demonstrated  very  useful 
test  scorc/undergradiiaic  pilot  training  (HPT) 
performance  validity  and  a  Navigator  Altitudinal 
•Survey  which  shows  promise  for  identifying  likely 
self-initiated  eliminees  (SIEs).  Data  obtained  from 
test  administration  at  Mather  AFB  will  be  compared 
to  undergraduate  navigator  training  (II  NT) 
performance  as  well  as  uses  for  tracking  each  student 
through  Combat  Crew  Training  School  (CCTS)  and 
the  first  year  in  an  operational  setting. 

I I  tilizalion :  The  selection  procedures  developed 
will  be  used  by  the  Air  Training  Command. 

Benefits :  l 'sc  of  an  improved  navigator  selection 
system  will  reduce  attrition  from  DINT  and  will  assist 
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ill  idciitilv tup  superior  navigators  m  an  upov.ilioii.it 
-.nii.nl  run 


Utli- :  Selection  fiir  l‘ilnl  Training 

/><  .-<  r  tfi  (in  ft  .  Iliv  Air  Force  Offirrr  (Qualification 
lest  (iimiiHisili'  ti a—  long  boon  (In'  primarv  selection 
Innl  lor  citlrv  into  l  ndcrgradtiule  I  *  ■  lot  training 
I  hi-  now  research  program  will  investigate  dir 
feusihililv  nf  ti-dug  tests  which  measure  psv I'lioniutnr 
uhilitv  as  wi  ll  as  •icrformam  c  nil  a  desk-top  flight 
siiniilalor.  I'ln-  program  tails  fur  ti-sting  largr 
samples  nt  mini  qualified  students  from  tin-  Reserve 
Officers  I  raining  Corps.  \ir  Force  Academy.  and 
Otliccr  Training  Si  hoot  commissioning  sourees  nil 
e\|ii  rimcnl.il  psvchnmolor  anil  learning  sample 
measure,  \nnltier  major  segment  il  the  program 


involves  an  extensive  %-v alnatinn  of  the  An  Puree 
|  light  Sereeiting  Program  In  addition  to  the  new 
test-  wliieh  measure  iisvehomotor  ability.  a  Pilot 
\tliliidinal  Survev  will  iie  administered  to  assist  in 
idenlilv  mg  the  most  siiitahle  type  of  aircraft  for  each 
student  and  the  identification  of  students  who  jre 
most  likelv  to  he  self-initialed  eliminees  for  reasons 
other  than  academic  nr  fixing  training  deficiencies. 

I  tilizat inn  :  The  ttew  selection  system  will  he  used 
hv  Air  Training  Command. 

Hi  nt-fits:  Tin-  benefits  of  the  new  system  will  take 
die  form  of  reduced  attrition  from  l  ndergradiiate 
Pilot  Training,  the  thorough  examination  of  the 
effectiveness  of  the  Plight  Screening  Program,  and 
die  identification  of  superior  pilots  in  an  operational 
setting. 


Portable  Flight  Simulation  Testing. 


SIMULATION  TECHNOLOGY  FOR  TRAINING 


Tide:  Advanced  Simulator  for  Pilot  Training  Aerial 
Refueling  Visual  Simulation  —  Engineering 
Development  Phase  D 

Description:  The  objective  of  this  project  was  to 
further  expand  the  capabilities  of  the  Advanced 
Simulator  for  Pilot  Training  (ASPT)  to  assess  the 
minimum  level  of  detail  required  to  perform 
receiver  aerial  refueling  tatlu  in  a  B-52  aircraft 


simulation.  This  capability  was  requested  by  the 
Simulator  System  Program  Office  (SIMSPO)  at  the 
Aeronautiral  Systems  Division.  Air  Force  Systems 
Command.  SIM  SPO  is  responsible  for  providing  the 
Air  Forre  major  commands  with  all  simulator 
equipment  required  to  meet  operational  training 
requirements  for  fortheoming  simulations,  including 
the  receiver  aerial  refueling  task.  The  inherent 
flexibility  of  the  ASPT  system  was  able  to  best 
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pruv )*ir  ihr  ini:iirr«m-  •'  \  p*  r  i  ill  e  n  1 .1 1  t  n  o d  i  J  i .•  :i  ' 
r»*t  In  <1 1*  I  *•  rrn  i  n*-  the*  imp;*.  I  -»r.  |>  1 1  •  *  I 

perbr  m  .ill*  r  of  Mich  variable-  J-  hold  <>|  irv. 

( i  O  \  i .  tanker  nn age  d«  rail.  an. I  da v  /night  v  mi  So! .( \ 

\  h-r  the  iier«*»;*rv  additional  \M*I 
- 1  r  ;• !  tonal  capabilities  re nMno  t.  d  I  j-ri  nn  tin 
ii  (  i*i  \  i*r  arria «  i  -I u»  ieig  f * •  i-^um  '••fiurii'.  !*»  h  i  v  m  r.ii 

r;  M-an  h.  ami  MM  >1*0  ft-ijuimin  Hi'  >IM>P<* 

ita?t*d  '.he  generator*  of  onr- 
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iimiuitM'-  H»\  "t\»ral  different  k  F  1  >«  tanker 
models  ilt  \ «!- with  various  level.  .,i  detail, 

-uii  o{  which  diffeid  from  those  Used  in  ilu*  l*has<  • 
r  -ear'  h  im  rformed  m  FX  78.  Strategic  \i: 
Command  piiot-  •  nrrert  in  th»*  B-.ll!  airer.ift  *<  re 
o-e<i  a>  subjects  i ;i  » h  •  -tud'.  M  inor  adjii.i  ruriiis  u •  n 
made  tti  the  \>l  t  \-M>\  flight  dwiain.!*-  and 
i  cnMol  lt»rn-  .r.  ini  ,<:!♦  nij)l  !<  approyimah  (In  B->7 
aircraft  ha ndlm g  qualities.  I  his  was  a<  i  nm plisht  d  by 
adjusting  the  thrust.  drag,  nil'  ll,  roll.  engine  response 
time.  ;nd  gross  weigh'  Tailors.  \  dynamic  «raphic- 
Jhpiav  was  pi  ugr.im  m<d  to  facilitate  the  «nstruitor/ 
i  p»  rafor  in  guiding  the  pilot  into  position. 

Iripw  1.  The  modifh  ation  of  tin*  \SPT 

'leiii  which  resulted  in  the  additional  eaodhility  to 
perform  re«eiver  aerial  refueling  sim uiaiiou  will  be 
utdi/a  d  in  a  number  of  ways.  One  rehear*  h  study  has 
been  performed  addressing  FOX  and  tanker  image 
•  I  *  (ail  requirements:  a  second  stud)  w  a.-  com  oletrd  to 
a.—ess  the  minimum  level  of  tanker  detail  needed  tor 
a  B-.7J  pilot  to  accomplish  aerial  refueling.  It  is  al.-o 
antieipared  that  the  capability  will  be  utilized  in  the 
fraining/researeii  programs  for  the  A  1 0 A  and  F-16 
aircraft. 

}hinr fits:  The  it  idv  conclusions  mav  be  effectively 
utilized  in  specifications  of  future  flight  simulators 
having  the  potential  of  resulting  in  considerable 
dollar  savings,  reduced  training  time,  enhanced 
operational  readiness,  and  increased  capabilities  and 
training  effectiveness. 


Title:  Advanced  Simulator  for  Pilot  Training 
(Computer  Ipdatc 

Description :  The  Advanced  Simulator  for  Pilot 
Training  (ASPT)  system  was  delivered  with  a  single 
Systems  Fngineering  laboratory  (SKL)  86 
Computer  to  perforin  flight  and  motion  cueing 
simulation  and  performance  measurement  on  two  T- 
37 B  cockpits.  The  iteration  rate  of  this  system 
resulted  in  a  lack  of  confidence  in  motion  research 
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operational  and  in  use  by  A  FUR  I.  n.  on  -going 
resea rcb. 

He  nr  fits.  The  im  rcased  capabilities  provided 
through  the  high  fidelity  simulation  of  the  newest 
aircraft  in  the  Air  Force  inventory  vastly  improve 
the  research  potential  of  the  ASPT  system.  A  M-  Hz 
iteration  rate  is  expected  to  allow  simulation  of  jl» 
known  aircraft;  however,  sufficient  computer  p<  wer 
exists  witli  the  A»SF>T  system  to  research  the  effects  of 
a  60-Hz  iteration  rate.  The  current  ASP  I  system  will 
permit  evaluatin'*  of  g-seat.  g-smt.  visual,  and  motion 
cueing  requirements  in  a  variety  of  aircraft  and/or 
environments;  i.e  .  air-to-surface,  air-to-air.  hostile, 
tactical,  and  aerial  refueling.  Advanced  training 
features  to  include  extended  opeiatioii  and  system 
performance  measures  can  be  used  concurrently  in 
the  exploration  of  these  parameters.  Of  critical 
importance  is  the  fact  that  the  research  can 
effectively  anticipate  actual  procurement  windows. 


Title:  Flight  Simulator  Runway  Visual  Textural  (lues 
for  landing 

Description .  The  lack  of  adequate  flare  and  final 
touchdown  visual  information  cues  has  been  a 
longstanding  criticism  of  flight  simulators  in  general. 
One  typical  fault  often  suggested  to  exist  is  the  lack  of 


adequate  textural  information  in  the  visual  scene 
that  is  needed  to  provide  good  rues  for  depth 
perception.  The  flexibility  of  computer-image 
generation  (GIG)  which  permits  rapid  variation  of 
the  content  of  the  visual  scene  was  chosen  to  permit 
experimental  investigation  of  visual  textural  rues  for 
landing.  The  experimental  approach  consisted  of 
having  experienced  instructor  pilots  fly  straight-in 
approaches  and  landings  in  the  T -.17  simulation  on 
the  Advanced  Simulator  for  Pilot  Training.  Seven 
different  runway  scenes  were  used  in  order  to 
compare  pilot  performance  differences  between 
different  levels  of  visual  texture  cues.  Six  of  the 
pilots  also  flew  touch-and-go  landings  at  the  Air 
force  Flight  Test  Center  in  order  to  provide  data 
concerning  typical  pilot  landing  performance  in  the 
T-.17  aircraft.  The  simulated  aircraft  average  vertical 
velocity  at  touchdown  decreased  svslematically  from 
201  feet/minule  for  the  night  runway  without  the 
touchdown  (Tl>)  /.one  lights  to  11<>  feet/minute  for 
the  day  runwav  with  1-foot  texture  patterns.  The  day 
runways  alone,  without  the  overrun,  varied  from  0)5 
feet/minute  for  the  hare  hones  runway  to  136  feel/ 
minute  for  the  1-foot  texture  patterns.  Although 
these  average  vertical  velocities  were  still  much 
higher  than  those  recorded  in  actual  airt  raft  landings 
(.12  feet/minute),  the  texture  patterns  did  influence 
the  pilot's  flare  and  touchdown  in  a  systematic 
manner.  Additional  visual  cues  might  have  reduced 
the  vertical  velocities  even  more  hut  the  limited  edge 
capacity  of  the  GIG  scene  did  not  permit  study  of 
other  visual  cues  while  investigating  texture  patterns. 
The  presence  of  the  TI)-Zone  lights  in  the  night 
scene  also  reduced  the  average  vertical  velocity  at 
touchdown  (1W  feet/minute)  but  this  difference  was 
not  statistically  significant.  The  presence  of  the 
runway  overruns  on  the  daytime  runways  limited 
the  range  of  touchdown  vertical  velocities  to  a 
smaller  range,  spanning  from  I  7(>  feet/minute  for  the 
Williams  AFB  runway  to  158  feet/mimite  for  the  1- 
foot  textured  runway.  When  the  overrun  was 
present,  apparently  the  pilots  used  the  overrun  visual 
cues,  the  chevron  texture  patterns,  and  other  related 
cues,  in  addition  to  the  runway  texture  patterns  in 
order  to  perform  flare  and  touchdown.  This  resulted 
in  reduced  overall  touchdown  vertical  velocities  but 
apprently  the  more  uniform  (restricted  range)  pilot 
performance  did  not  involve  an  optimum  use  of  the 
1-foot  texture  patterns.  Several  other  data 
parameters  also  varied  across  runway  types; 
however,  there  were  no  consistent  differences  related 
to  runway  texture  patterns.  The  statistically 
significant  effects  with  the  other  data  parameters 
were  most  often  related  to  differences  between  the 
night  and  the  day  runway  scenes. 


Impart :  The  results  of  this  studv  and  related  follow- 
on  studies  will  permit  definition  of  the  requirements 
for  improved  visual  simulations  and  to  pursue 
technologies  for  providing  more  adequate  v  isuai  cues 
during  the  flare  and  touchdown.  The  results  of  this 
study  should  also  have  impact  on  defining  the  visual 
cue  requirements  for  other  low  level  flight 
environments  such  as  contour  and  nap-of-the-earth 
flight. 

tienefits:  The  current  lack  of  adequate  flare  and 
final  touchdown  visual  information  cues  in  flight 
simulators  reduces  the  amount  of  effective  transfer 
of  training  from  the  flight  simulators  to  the  aircraft 
during  flare  and  landing.  Improvements  in  these 
visual  cues  should  increase  the  effective  transfer  of 
training  from  flight  simulators  to  aircraft  during 
flare  and  touchdown.  A  better  understanding  of  the 
requirements  for  low  altitude  visual  cues  should  also 
enhance  the  effectiveness  of  low  level  flight 
simulations.  This  potential  application  will  probably 
have  even  much  greater  impact  of  flving  training 
because  of  the  hazards  and  restrictions  inherent  in 
low-level  flight  in  actual  aircraft. 


'title  :  KG- 135  Compute  M>ene  rated  Image  Modeling 
Requirements  for  B-52  Aerial  Refueling  Simulation 

Inscription:  The  purpose  of  this  research  was  to 
identify  the  minimum  model  visual  detail 
requirements  necessary  for  computer-generated 
image  simulation  of  aerial  refueling  (  A  R  )  of  the  11-52 
aircraft  by  a  KC-135  tanker.  Three  levels  of  detail 
were  employed;  low  (200  edges),  interim*  diate  (700 
edges)  and  high  (1,100  edges).  Two  levels  of 
illumination  were  employed;  day  and  night  KC- 
1.15 A  models  were  constructed  based  upon  a  survev 
of  cues  employed  by  Strategic  Air  (Command  (SAG) 
pilots.  Twelve  experienced  B-52  pilots  (not  less  than 
500  hours),  who  were  current  in  the  aircraft,  were 
employed  as  subjects.  These  pilots  were  provided 
with  two  familiarization  training  sessions  prior  to 
data  collection.  All  pilots  were  required  to  meet  a 
training  criterion  of  six  refuelings  of  I  minute 
cumulative  contact  prior  to  data  collection.  One  pilot 
was  eliminated  due  to  inability  to  achieve  the 
training  criterion.  The  Advanced  Simulator  for  l’ilot 
Training  (ASPT)  was  employed  for  this  research. 
Refueling  was  accomplished  in  an  A- 10  aircraft 
configured  cockpit,  a  circumstance  which  required 
pilots  to  adapt  to  a  different  throttle  and  slick 
configuration  than  present  in  the  B-52.  The  field  of 
view  was  electronically  masked  to  approximate  that 


.15 


iniiiTlrd  lor  l lit-  B-.'>2  Weapon  System  Trainer 
W  ST)  ±2t  degrees  horizontal  and  +2)  degrees.  - 
10  degrees  vertical.  Iroiu  the  design  eve.  A  I  d? 
aircraft  canopy  litis  eonfiguralion  was  employed  to 
provide  a  windscreen  reference.  Flight  dynamics 
approximated  those  of  a  K-.i2C  model  in  the  \R 
envelope.  However,  it  was  mi  possible  to  provide  a 
throttle  quadrant  with  a  neutral  setting  during 
refueling.  Pilots  were  initialized  100  leet  lielow  and 
200  feet  in  trail  behind  the  kC-CCi  tanker.  Subjects 
proceeded  to  preeontaet  at  10  feet  helow  and  >0  feet 
liehind  the  tanker  The  console  operator  served  as  a 
surrogate  boon)  operator  to  talk  the  pilot  into 
position.  A  computerized  voice  sv nthesi/.er  informed 
the  pilot  when  contact  hail  been  achieved  broken  or 
criterion  had  been  achieved.  A  criterion  of  one 
minute  cumulative  contact  per  trial  was  employed  in 
data  collection.  I  It  esc  were  six  models— three  day 
and  three  night— at  low.  intermediate,  and  high 
levels  of  detail,  respectively.  The  subjects  flew  three 
repetitions  per  model  during  data  collection,  a  total 
of  IN  dials.  Dependent  measures  included  (a)  total 
time  in  seconds  from  preeontaet  to  contact;  (h)  total 
disconnect  time  in  seconds  prior  to  criterion;  (c) 
number  of  disconnects  prior  to  criterion,  (d)  total 
K  MS  (TOTSCORF',  =sum  of  KMS  deviation  scores 
(e)  through  (i)  as  follows);  («■)  RMS  horizontal 
deviation  from  preeontaet  to  contact:  (II  KMS 
vertical  deviation  from  preeontaet  to  contact ■  (g) 
RMS  horizontal  deviation  during  contact;  (h)  RMS 
vertical  deviation  during  contact:  (i)  RMS  fore/aft 
deviation  of  boom  during  contact:  (j)  RMS  throttle 
movement;  (k)  RMS  slick  movement:  (1)  aileron 
power:  and  (in)  elevator  power  Subjective  results 
front  a  standardized  questionnaire  indicated  that 
pilots  found  visual  cues  were  best  represented  on  the 
complex  model  (I.F00  edges)  and  preferred  it  for 
motion  detection  to  the  less  detailed  displays.  The 
field  of  v  icw  (  F8  d  egrees  by  .'ft  degrees)  was  rated  as 
satisfactory  for  performing  the  AR  task.  Pilots 
reported  they  adapted  to  the  \  - 1  (>  cockpit,  hut  found 
the  throttle  response  unrealistic.  The  objective 
performance  results  indicated  that  simulated  day  and 
night  refueling  can  be  accomplished  with 
considerably  less  than  the  edges  requested  by 

SAC.  In  general,  performance  with  the  austere 
model  (200  edges)  was  less  satisfactory  than  that  of 
either  the  intermediate  (700  edges)  nr  complex 
( l.foo  edges),  hut  not  dramatically  so.  Ov  erall 
differences  between  intermediate  and  complex 
models  were  negligible. 

Im/xii  l  The  present  results  indieate  that  detail 
levels  of  approximately  700  to  1.000  edges  can  lie 
satisfactorily  employed  for  simulated  refueling, 
provided  a  representative  selection  of  rues  is 
portrayed.  Both  the  present  study  and  previously 
accomplished  research  found  that  a  field  of  view  of 
about  F8  degrees  hv  ff  degrees  is  satisfactory  for 
training  in  the  A  R  task 

lirn  r  fit v  The  results  of  this  research  w  ill  he  used  in 
procurement  specifications  lor  the  H-.72  WST.  as 
pertain'  to  requirements  for  AR  simulation 
requirements.  Such  data  are  useful  in  assuring  that 
such  procurement  specifications  are  rusl-effeelive  in 
meeting  training  requirements. 


T 


( aim  jniter-Ornrraled  linage  of  Serial  Refueler 
(k(.-i  Ci). 


Title;  Pilot  Performance  in  Simulated  Aerial 
Refueling  as  a  Function  of  Ianker  Model  Complexity 
and  Visual  Display  FVkl  of  View 

/ ic.vc r i/> t ton  :  I  wo  experiments  were  conducted  Jn 
the  Advanced  Simulator  for  Pilot  Training  (\SPT) 
to  determine  tanker  detail  level  and  field-of-v iew 
(FOV)  requirements  for  aerial  refueling.  1  his 
research  was  performed  to  provide  data  to  the 
Simulator  System  Program  Office  (SIMSPO)  at  the 
Aeronautical  Systems  Division.  Air  Force  Systems 
Command,  which  specified  the  aircraft  and  FOVs  to 
lie  simulated.  The  purpose  of  the  studies  was  to 
determine  the  effects  on  pilot  performance  ol  tanker 
model  level-of-detail  in  the  context  of  display 
systems  the  SIMSPO  is  procuring.  The  adequacy  of 
three  detail  level-  and  five  different  FOVs  was 
assessed.  Tile  three  detail  levels  employed  for  both 
experiments  varied  according  to  the  visual 
complexity  of  the  kC-l.ki  tanker  aircraft.  Study  1 
simulated  the  \-H>  and  F-f  aircraft  and  employed 
the  FOV  sizes  and  positions  for  those  aircraft 
specified  hv  tin-  SIMSPO.  Study  2  simulated  the  B- 
,32  and  F/FB-I  I  I  aircraft.  These  FOVs  were  based 
upon  already -initiated  simulator  procurement 
actions.  However,  the  FOV  positions  and  sizes  had 
been  specified  on  the  basis  of  requirements  to  train 
airerall  takeoff  and  lauding  in  the  simulator.  V 
determination  of  FOV  adequacy  to  train  aerial 
refueling  (AR)  also  was  desired  In  addition  in  the 
four  FOVs  just  discussed,  the  full  FOV  in  ASl'T  was 
employed  in  both  studies  to  provide  an  additional 
basis  of  comparison.  Six  pilots  from  the  1  aetieal  A  ir 
Command  fl  At.)  and  six  from  tile  Strategic  \ir 
Command  (S  AC)  served  as  subjects  for  this  research. 
Participating  S  AC  pilots  judged  the  locations  of  the 
U-.»2  and  F/FB-I  I  I  FOVs  to  lie  satisfactory  at  AR 
preeontaet  and  contact  positions.  I  he  I  VC  F-F  and 
A  -  It)  pilots,  however,  raised  the  FOV  an  average  of 
1 2  degrees  to  a*a  om plish  A  R  .  A  -I  tt  pilots  found  that 
the  1 2-degrcr  change  interfered  with  their  ability  to 
lake  off  and  land  in  the  simulator,  and  F -i  pilots 
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experienced  great  (liffia  iiltv  with  both  takeoff  ami 
landing.  In  Slinlv  I  (A-llland  F -4).  difficulty  in  All 
was  shown  to  lx-  a  function  of  model  com  [devils  and 
H)\  size-.  As  complexity  increased,  the  average  time 
needed  to  complete  All  and  the  average  number  of 
disconnects  decreased  significantly.  As  FOV  size 
increased,  the  average  time  to  criterion  and  the 
average  n  inn  her  of  disconnects  decreased 
significant!* .  The  performance  measurement  results 
from  Study  1  (B-.32  and  F'/FB-l  I  I)  we're  similar  to 
those-  in  Study  I  described  above.  Overall  receiver 
aircraft  oscillation,  as  a  function  of  model 
complexity,  was  insignificant  for  TAC  pilots  hut 
highly  significant  for  SAC  pilots.  Oscillation  as  a 
function  of  FOV  was  significant  for  all  pilots.  In 
debriefing,  the  pilots  reported  that  many  of  the' 
visual  cues  they  normally  use  to  refuel  were  not 
present,  even  on  the  complex  model  employed  in 
this  research. 

Im part :  Results  from  the  refueling  task  indicate  the 
largest  S I  \1  S  I’O-specificd  FOV  was  far  superior  to 
the  smallest  one  but  not  as  effective  as  the  full  FOV  . 
Similarly,  the-  most  complex  model  was  superior  to 


the  least  complex.  FOV  ami  model  detail  level  arc 
important  variable's  in  VR  simulation,  as  is 
placement  e.f  tanker  visual  cues.  Because  many  ot  the 
eiji-s  they  ordinarily  use-  we-re  missing,  the  pilots 
le-arni'd  to  utilize  e'lies  I'visting  in  the  sim illation . 
VI  hen  the  model  die!  not  include  as  in  tie'll  eb'lail  (e  g  . 
three-dimension  engine  nacelles)  or  when  less  eel  the 
tanker  was  visible  in  a  smaller  FOV  .  the  performance 
deteriorated. 

He  nr  fits :  These  ri'sults  indicate'  that  no  less  a  tanker 
eb'lail  leve  l  than  that  associated  with  the-  complex 
inode-1  in  this  study  shemld  he-  employed  for  VR 
sim  illation  so  that  pilots  will  have'  sufficient  visual 
cues  to  perform  the  task.  Also,  care  should  be  taken 
to  construct  the  model  with  a  better  selection  ol 
frequently  employee!  All  visual  e*ue*s  than  that 
utilize'd  in  till'  prese-nl  study:  e've'ii  a  e'oinph'X  moiled 
is  ina<ie-i|iiati‘  if  nee-e-ssary  cues  are-  lacking.  I  he' 
re-sults  furthiT  suggest  that  the  effectiveness  oi  the 
one'-winelow  elisplay  for  VR  simulation  training  is 
limiteii  and  that  a  single-  windeiw  cannot  be-  use-d  to 
train  both  transition  and  VR  in  I  At.  aircraft 
simulators. 


TECHNICAL  SUPPORT 


Title:  Comprehensive  Occupational  Data  Analysis 
Programs 

Description:  The  Comprehensive  Occupational 

Data  Analysis  Programs  (CODAP)  system  was 
developed  in  response  to  the  need  for  an  efficient 
and  effective  method  to  identify  and  classify  jobs  in  a 
rapidly  changing  Air  Force.  The  basic  input  to  this 
system  is  information  provided  by  a  large  number  of 
supervisors  and  job  incumbents  in  the  oerupational 
area  being  studied.  Be-e-ausc  the  data  are  collected  at 
the  worker-task  level.  Comprehensive  Occupational 
Data  Analysis  Programs  (COD  A  P)  provide-s  a  base  of 
information  which  may  he  viewed  in  many  ways  and 
address  new  anil  unanticipated  management 
questi  >ns  whenever  they  arise-.  The  technical  support 
during  the  past  year  has  he-en  aimed  at  providing  an 
easy  method  to  restructure  and  summarize  these  data 
for  higher-level  management  in  more  widely  diverse 
functional  areas. 


Impact/U  tilization:  In  addition  to  its  operational 
usages  in  developing  and  validating  the  content  of 
training  programs.  CODAP  is  being  used  to  address 
questions  about  the  requirements  of  jobs  which  will 
be  integrated  into  the  initial  personnel  selection 
process  and  eventually  into  the  person-job  match 
(PJM)  model.  Although  developed  by  the  Air  Force, 
all  branches  of  the  United  States  Department  of 
Defense,  as  well  as  the  British.  Canadian,  and 
Australian  Forces,  have  incorporated  CODAP  into 
their  operational  programs.  In  the  non-DOD  public 
sector,  many  stale  and  country  governments  are 
beginning  to  use  COD  A  P  to  validate  their  traditional 
testing  and  selection  procedures,  and  at  the  same 
lime  develop  performance  evaluation  criteria. 
Fdueational  institutions  are  using  COD  A  I’  to  modify 
the  curriculum  of  the  vocational  education 
programs. 
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Benefits:  The  traditional  benefit  of  providing 

relevant  training  is  still  continuing  and  the  most 
recent  improvements  to  the  fOPAI1  -vstcm  have 
been  designed  to  facilitate  that  operational  program. 
I  he  near-term  benefits  will  be  realized  with  the 
results  of  the  aptitude  requirements  project,  which 
used  the  historical  PODAP  data  base  of  all 
occupations  along  with  enhanced  programming 
capabilities  to  realign  entry-level  aptitude 
requirements  across  A  ir  Force  career  fields  The  next 
level  benefit  will  be  improved  definition  of  job 
requirements  for  integration  into  the  overall  person- 
job  match  il’JM!  model  under  development.  The 
long  range  benefit  will  he  the  spin-off  from  the 
public  sector  activ  dies.  \s  each  state  is  attempting  to 
assess  the  shill  pool  available  to  attract  new  business, 
the  t.ttlt\l’  >v stent  i-  providing  a  common  basis  bv 
which  a  National  Shills  Assessment  Program  tnav  he 
developed  and  provide  the  Department  of  Defense 
with  an  accurate  picture  of  the  civilian  labor  force 
from  which  it  draws. 

Title :  Pile  hem  Data  Organizer 

Description :  I  lie  l  ile  Item  Data  Organizer 

(I  IDO)  evolved  fiiiin  the  need  of  researeh  efforts 
involving  present  and  longitudinal  sample  selection 
where  codes  contained  in  tin-  IFHIil.  unique  data 
base  had  to  In'  identified  and  interpreted  bv  researeh 
scientists  with  Knglish  meanings  for  coded 
information  including:  description  ol  the  code, 
frequency  of  occurrence,  and  other  descriptive 
statistics,  F  IDO  also  contains  an  automated  inquiry/ 
retrieval  system,  vital  for  the  establishment  of  data 
bases  for  personnel  research  projects  and  probe 
analysis  to  determine  the  feasibility  of  proposed 
major  research  efforts  iuvolv  ing  data  bases.  FIDO  is 
on-line  on  the  AFUHl.  I  NIVAh  1108  computer 
system.  It  consists  of  <>77  Air  f  orce  and  DOD  defined 
data  elements  used  in  automated  Air  Force 
Personnel  Data  .Systems;  examples  are  security 
classification,  grade.  Air  Force  Specialty  (lode,  and 
major  academic  field.  Present  efforts  are  to  provide 
more  accurate  and  timely  data  hy  improving  the 
update  procedures  now  in  use  and  hy  developing 
procedures  to  get  this  information  directly  from  the 
Air  Force  Data  Systems  Design  Outer  AFM  .100-1 
data  base  which  is  supplied  to  A  FUR  I,  monthly  hy 
magnetic  tape. 

Im  par  t/ll  tilizatin  n  :  FIDO  directly  supports 
virtually  all  facets  of  personnel  and  manpower 
research  across  A  FUR  I.  divisions.  Many  research 


efforts  involve  longitudinal  studies  of  specific 
samples  cutting  across  many  different  data  files  and 
eoile  values  over  varied  time  periods.  Automated 
availability  of  Air  Force  and  1)01)  defined  data 
elements,  as  well  as  other  nonsTandard  data  elements, 
with  their  data  items  and  meanings  across  time  w hen 
combined  with  heavy  usage  hy  programmers/ 
analysts  represents  a  sizeable  savings  in  workluturs 
which  would  otherwise  he  spent  in  researching 
hundreds  of  manuals,  and/or  microfiche  hy  hand  in 
order  to  find  the  needed  code  properly  identified  for 
a  given  historical  time  period.  As  implemented, 
scientists  may.  on  retrieval,  specify  all  code  values  in 
effect  dating  back  to  the  establishment  of  a  given  data 
element  or  may  specify  inclusive  dales  and  get  only 
those  codes  in  effect  during  the  interval  in  question. 
The  data  can  he  displayed  on  a  remote  interactive 
terminal  or  a  hard-copy  may  be  requested  showing 
title,  data  name,  definitiou/explanation.  code  values, 
effective  dates,  and  explanation  of  code  values. 

Benefits:  FIDO  makes  it  possible  to  carry  out 

research  studies  which  would  be  prohibitive  in  terms 
of  workhours  required  without  an  automated 
inquiry/retrieval  system . 


Title:  Human  Resources  Researeh  Data  Rase 

itest  n/ition :  A  series  of  data  bases  containing 

information  on  personnel  and  training  systems  has 
been  developed.  The  data  bases  are  stored  on 
magnetic  tape.  Software  to  process,  organize,  and 
display  selected  information  from  a  single  data  base 
and  to  consolidate  information  on  a  common 
subgroup  from  two  or  more  data  bases  has  been 
implemented.  The  data  bases  include  records  on  all 
active  duty  Air  Force  enlisted  and  officer  personnel 
at  6-month  intervals;  Air  Force  Reserve  and 
National  (luard  Personnel;  records  of  graduates 
from  basic  military  training,  technical  training,  and 
flying  training  programs  and  from  the  Officer 
Training  .School  and  Reserve  Officers'  Training 
dorps  commissioning  programs;  and  records 
reflecting  separations  and  losses  from  active  duty. 
Special-purpose  longitudinal  files  have  been  derived 
from  these  data  bases.  These  longitudinal  files 
significantly  reduce  data  processing  requirements  in 
many  personnel  and  training  researeh  studies. 

Impael/ll tiliznlion:  The  data  bases  represent  a 
low-cost  means  of  acquiring  and  maintaining 
information  used  in  the  development  and  validation 


of  personnel  selection  and  classification  instruments, 
development  ol  assignment  pruned ures.  derivation 
and  revalidation  ol  promotion  svstems.  and  speeial- 
purpose  analy  ses  to  determine  the  long-range  I  in  pact 
of  specific  personnel  and  training  policies. 

Benefit s:  \ v uilahilitv  of  these  data  liases  makes  it 
possible  to  carry  out  studies  on  numerous  aspects  of 
the  personnel  and  training  svstems  which  otherwise 
would  not  he  feasible.  A  conservative  estimate  of  an 
annual  enst-avoidance  of  .">00  thousand  dollars  c  an  he 
attributed  to  the  use  of  these  automated  data  bases  as 
an  alternative  to  manual  screening,  selection,  and 
automation  of  records  maintained  in  archival 
storage. 


Title :  Officer  Effective  ness  Report  System 

Description:  Officers  are  normallv  given  Officer 
Fftectivo  Report  (OFR)  evaluations  once  a  vear. 
There  are  several  uses  for  the  evaluations:  (a)  a  tool 
in  determining  the  best  individuals  qualified  for 
promotions,  (h)  a  tool  for  making  assignments,  (c)  a 
counseling  device,  and  (d)  a  general  personnel 
management  tool.  In  addition,  these  reports  aid  in 
•  he  monitoring  of  the  rating  trends.  The  automated 
OF R  report  system  uses  the  OFK  records,  which 
have  been  transcribed  to  magnetic  tape,  to  produce 
summary  reports  on  a  quarterly  and  yearly  basis  foi 
grades  of  lieutenant  through  colonel,  separated  The 
reports  aid  assignment  managers,  career  monitors, 
personnel  managers,  and  OFH  monitors. 

Im  pactU'  tilizntion:  The  OFR  summary  reports 
are  used  by  senior  Air  Force  managers,  the 
promotion  secretariat,  career  monitors,  and  OFR 
monitors. 


Benefits.  The  Air  Force  is  in  a  better  position  to 
monitor  the  OFR  system  and  its  built-in  controls  as  a 
result  of  the  sumruarv  report  system  developed  by 
AFIIHI.. 

Title  :  Technic  a  I  Training  Oraduation/hliniination 
Rates 

Description:  Summary  reports  for  Air  Force 
enlisted  personnel  who  terminate  technical  traiing  in 
each  quarter  of  the  fiscal  vear  and  aggregated  over 
the  fiscal  year  are  prepared  quarterlv.  T  hese  matrix 
formal  type  reports  contain  statistics  (for  all 
individuals  who  terminated  a  particular  course  in  a 
specific  quarter  of  the  fiscal  year),  such  as  frequence 
counts  and  percentages  for  reasons  for  termination  of 
training:  average  M  cchanical.  Administrative, 
tie  n  oral.  Fleet  ronies  and  Armed  Forces 
t,)uali!ieation  lest  scores  for  graduates  and 
eliminees;  minimum  selector  aptitude  index  (Al) 
-core  for  entry  into  the  course:  and  average  time  in 
training  for  graduates  and  eliminees.  All  of  the 
aforementioned  frequency  counts  and  percentages 
lor  all  individuals  are  reported  by  race.  sex.  race/sec. 
f-vear  or  6-year  enlistment,  academic  education 
level,  and  mental  category. 

Impact!!  tilizntion:  The  reports  are  used  b\ 
personnel  systems  managers  to  track  graduation/ 
elimination  rales  of  Air  Force  enlisted  personnel 
from  basic  resident  technical  training  courses. 

Benefits :  The  reports  are  being  used  to  focus  on 
total  attrition  '••otn  technical  training  courses  with 
special  emphasis  on  the  high-cost  courses:  and  also 
for  briefings  at  higher  echelons,  and  for  updating 
trends  tables. 


TECHNICAL  TRAINING  TECHNOLOGY 


Title:  Development  of  Fffirient  ( ,  0111  pule  r\s  s  is  tell 
Instruction  Authoring  Procedures  for  Ise  in  a 
Technical  Training  Fnvironme lit 

Description.  The  instructional  effectiveness  of 
computer-assisted  instruction  (C.AI)  has  been 
demonstrated  repeatedly  for  a  large  variety  of 
instructional  applications.  The  principal  drawback  of 


t.Al  has  been  the  cost  of  developing  and  delivering 
FAl  materials.  This  effort  has  concentrated  on  the 
development  tasks  to  decrease  development  costs. 
(I  A I  lesson  development  times  may  range  from  100 
to  TOO  hours  to  prepare  1  hour  of  instructional 
material.  Often  a  team  approach  is  employed, 
involving  a  subject  matter  expert,  an  instructional 
programmer,  and  a  computer  coder.  This 
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requirement  for  spccializi'd  personnel  expending 
many  workhours  to  develop  one  instruetional  hour  i- 
the  ehief  reason  for  high  development  cu-i-  I  hi- 
effort  developed  a  set  of  procedures  who  h  allow 
existing  Air  Korn  teehnieal  training  personnel  to 
efficiently  prepare  instruetional  material-  and 
employ  instructional  strategies.  The  procedure,  are 
structured  about  an  author  editor  that  allow-  the 
lesson  developer  to  sit  at  a  terminal  and  concentrate 
on  material  production  since  lesson  design  i- 
somewhat  guided  by  the  editor,  and  the  coding  of  the 
computer  is  automatic.  (Graphics  displays  are  easily 
prepared  through  the  use  of  a  hit-pad  digiti/<  r  The 
results  of  this  effort  are  documented  in  AFHKI  -TR- 
79-74,  Computer-Assisted  Instruction  in  the 
Context  of  the  Advanced  Instructional 
.System:  Materials  Development  Procedures 
and  System  Evaluation. 

Impact/lJ tilization:  The  authoring  procedures  are 
in  use  by  several  ATC  courses  at  l.owry  Teehnieal 
Training  Center.  Plans  to  extend  this  capability  to 
several  Tactical  Air  Command  and  Strategic  Air 
Command  installations  are  being  formulated. 
Relevant  lessons  on  other  computer-based 
instruction  (CBI)  systems  are  being  reviewed  for 
possible  use  on  the  l.owry  CBI  system. 

Benefits:  Evaluation  information  indicates  that 

lesson  development  times  average  about  85 
development  hours  per  student  hours  of  contact. 
This  indicates  a  higher  degree  of  efficiency  in  the 
lesson  development  process.  It  also  appears  that 
strategies  employed  are  reducing  student  failure 
rates.  CBI  users  have  been  pleased  with  the  results 
and  the  enhanced  capabilities  for  delivering  and 
developing  instructional  materials. 


Title:  Dua I  K V he 

Description:  The  microfiche  medium  offers 

proven  advantages  in  the  management,  storage,  and 
retrieval  of  information.  Advances  in  compuler- 
output-to-mierofiehe  (COM)  technology,  especially, 
brings  together  the  efficiencies  of  computer 
processing  and  the  cost  advantages  of  microfiche. 
COM  technology,  however,  deals  exclusively  with, 
and  is  designed  to  accommodate,  narrative 
information  (in  traditional  vertical  formats),  which 
has  limited  its  use  in  training  (where  pictorial  and 
horizontal  formats  are  commonplace).  While  both 
narrative-only  and  pictorial-only  microfiche  can  be 
produced,  a  combination  of  the  two  formats  presents 


pt  <du.  loin  p  i  •>  h !  c  in  -  |  he  dual-fuhe  concept 

-Cp.ir.lle.  I  to  pi  oil  111  I  ion  el  'he  lldrrjlive.  or  ll  XI. 
■  mu  ponciit  from  ilic  production  ot  (he  pictorial,  or 

graph . riipo  .ii:  yei  lornlnrie-  I h i  two  type-  of 

tnl.o mi  .  n  ji  i|n  point  ol  u-e  1 1  « -  the  microfiche 
n  ad<  f  '  ti .  'to.it  to  tic  prodiii  t  i-  a  fi-he 
-.1  io I w  .  n.  I, .  in  i  oiildiriing  text  or  narrative 

in  lor  in  a- Hi  n  itn  -ci  .Hid  In  he  loiitaining  graphics. 
It  ol  h  "iiagi.  ar  ■  projei  |e,|  -mi  iilldncoii.-lv  .  with 
word-  and  pnion-  hi  perlei  1  regi-lration  This 
dc  y  clopin  •-  n  t  bring-  I  to-  power  of  <  .< » M  to  bear 
directly  on  the  problem-  of  writuig  and  revising 
iTi.troiiioii.il  iii.ilerial-  I  he  dual-fii  he  approach  was 
developed  under  \ir  fore#'  t  ontrai  t  f -.t.lti)  i-77-t'- 
<Mt  >7  by  the  Itenyer  Ite-eareh  ln-titul<‘  and  utilize.- 
the  operational  eonlexl  of  the  Advanced 
Instructional  System  (\l>)  at  lowrv  AKB.  The 
effort  is  documented  in  A  K  H  K  I.  -  T  R  -79-<i, 
Microfiche  Application  in  on  Individualized 
Self-Paced  I. earning  System. 

Im  pac  til  tilization  :  The  contract  effort  resulted 
in  a  scenario  w  hich  could  place  the  development  and 
maintenance  of  instruetional  materials  in  the  hands 
of  Air  Training  Command  A  IS  instructors.  I  sing  an 
interactive  computer  terminal,  an  instructor  may 
write  or  edit  materials  which,  upon  completion,  are 
transferred  to  tape.  The  tape  is  then  loaded  into  a 
COM  machine  which  produces  the  microfiche.  As 
this  effort  is  a  demonstration  of  the  approach  and  the 
technology,  a  fully  operational  program  was  not 
implemented.  Further  developments  and 
refinements  are  anticipated. 

Be  nefits  :  The  dual-fiche  approach  expands 

instructional  material  development  and 
maintenance  capabilities,  greatly  reducing 
production  turnaround  times.  Full  implementation 
carries  a  potential  eost  avoidance  as  well  as  increased 
efficiencies.  Most  importantly,  the  scenario  places 
both  the  means  and  the  technology  itself  at  the 
disposal  of  learning  center  instructors  — eliminating 
reliance  on  time-consuming,  traditional  microfiche 
methodologies. 


Title:  Evaluation  of  I’l.ATA)  IV  in  Three  Air  F'oive 
Medical  (bourses 

Description  :  Training  sufficient  num  hers  of  skilled 
medical  personnel  in  less  time  than  required  by 
costly  conventional  methods  is  of  prime  interest  to 
medical  administrators.  F  nforlunately  .  there  is  little 
empirical  evidence  to  assist  decision-makers  in 
choosing  among  individualized,  self -paced 
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alternatives  to  lecture.  To  reduce  this  data  gap.  this 
medical  training  study  was  conducted  to  provide 
answers  to  two  major  questions,  (a)  Do  computer- 
assisted  instruction  (('41).  programmed  text  and 
lecture  differ  in  instructional  effectiveness  in  courses 
varying  in  difficulty  '  (b)  Do  students  who  differ  in 
characteristics  (e  g.,  aptitude  level  and  motivation) 
achieve  more  in  less  time  under  computer-assisted 
instruction,  programmed  text  or  lecture?  The 
following  technical  reports  document  this  study: 
A  I’ll  R  I.  -TH  -7  7-1  7.  Computer  Assisted 
Instruction  in  Air  Force  Medical  Training: 
Prelim  mars  Findings,  and  AFH  R  l.-TR  -76-76, 
Computer  assisted.  Programmed  Text,  and 
lecture  Modes  of  Instruction  in  T  h  ree  M  eihcal 
Training  Courses:  Comparative  Evaluation. 

Impact/l  tilizalion:  From  an  overall  standpoint, 
computer-assisted  instruction  ((141)  was  found  to  be 
more  instrurtionally  effective  and  efficient  than 
programmed  text  or  lecture.  The  more  difficult  the 
course,  the  greater  the  impact  of  computer-assisted 
instruction  on  achievement.  However,  the  degree  of 
effectiveness  and  efficiency  varied  with  aptitude 
level  and  course  difficulty.  Fur  example,  OAl 
increased  low  aptitude  student  achievement  as  much 
as  18  percentage  points  more  than  low  aptitude 
lecture  controls  in  the  difficult  course  and  7 
percentage  points  more  than  low  aptitude, 
programmed  text  controls  in  the  course  of  average 
difficulty.  No  significant  differences  in  achievement 
were  obtained  in  the  less  difficult  course.  In  contrast, 
high  aptitude  C.AI  students  completed  instruction  in 
.13%  less  time  than  their  high  aptitude  lecture 
counterparts.  Though  high  aptitude  (141  students 
generally  completed  instruction  in  30%  less  time 
than  low  aptitude  (141  students,  low  aptitude  (1.41 
students  achieved  more  in  17%  less  time  than  low 
aptitude  programmed  text  controls.  Hence,  the 
graphics  capabilities  of  interactive  (’41  appear  to 
compensate  for  the  typically  lower  reading  capability 
and  achievement  motivation  of  lower  aptitude 
students  such  that  their  (141  achievement 
approximates  the  achievement  of  higher  aptitude 
students  under  lecture  or  programmed  text 
conditions. 

Benefits :  This  evaluation  has  provided  decision- 
makers  with  evidence  bearing  on  the  instructional 
effectiveness  and  efficiency  of  (141  compared  to 
lecture  and  programmed  text  To  optimize  the 
effectiveness  and  efficiency  of  1.41.  programmed 
text  or  lecture,  learner  characteristics  profiles  were 
provided  which  permit  differential  assignment  of 
learners  to  instructional  modes  which  were  found 


more  effective  for  them,  liased  on  this  evidence,  ( 1 A I 
has  been  extended  to  several  other  courses  within 
medical  training. 


Title  :  Feasibility  of  Computer  Applications  forTask- 
Oriented  Training  in  the  Aiirrafl  Armament  Systems 
daieer  Field 

lie  scription-.  The  Air  Force  On-the-job  Training 
(OJT)  program  is  designed  to  prepare  its  personnel 
to  perform  tasks  required  to  support  the  mission  of 
the  Air  Forre.  Management  and  evaluation  of  the 
OJT  program  has  historically  been  a  recognized 
problem.  The  administrative  problems  associated 
with  scheduling  students,  instructors,  instructional 
materials  and  resources  for  OJT  are  sufficiently 
complex  that  inadequate  training  can  result.  Task 
proficiency  evaluation  in  OJT  involves  a  great 
number  of  judgments  by  the  OJT  supervisorArainer 
regarding  the  adequacy  of  an  individual's 
performance.  Moreover,  the  requirement  of 
observing  trainee  behavior  in  order  to  perform  these 
task  evaluations  is  time-consuming.  Ideally,  these 
observations  should  be  standardized  across 
evaluators  and  trainees  so  that  advancement  in  skill 
level  can  be  assessed  fairly.  Better  identification  of 
(raining  requirements  would  also  result  in  improved 
training.  More  accurate  knowledge  of  OJT  costs  and 
unit  OJT  capability  and  capacity  could  lead  to  better 
management  of  the  total  technical  training  system. 
Advancements  in  computer  technology,  especially  in 
the  field  of  computer-managed  instruction  systems 
((IMIS),  have  reached  a  level  where  it  may  be 
feasible  to  support  some  of  these  OJT  training  and 
management  requirememts.  The  purpose  of  this 
study  was  to  evaluate  the  potential  for  various  CM  IS 
applications  to  improve  the  management  of  unit 
level  training.  4  survey  of  the  OJT  environment  of 
the  46230  Aircraft  Armament  Systems  Specialist 
career  field  within  the  Tactical  Air  Command  was 
conducted.  Based  on  the  results,  a  detailed  training 
system  analysis  was  performed  for  the  F-15  weapon 
system.  Specific  function  within  the  weapon  system 
which  could  be  accom plished/supported  by 
computer  were  identified  and  specific 
recommendations  considering  trade-offs  were  made 
for  expansion  of  computer-based  technology  into  the 
OJT  environment. 

Im  pne  tIC  tilization :  The  recommendations  of  this 
study  were  based  on  observations  restricted  to  one 
major  roinmand  and  essentially  to  one  weapon 
system.  However,  the  potential  applications 
identified  should  be  applicable  to  OJT  as  practiced 
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throughout  the  Air  Force.  As  such,  they  are  of 
interest  to  training  policy  and  practice  managers  at 
command  and  staff  levels,  and  arc  reported  in 
.\FHRl.-TR-7(M»l.  Feasibility  of  Computer 
Applications  to  M ission-O riented  Training  in 
the  Aircraft  Armament  Systems  Specialist 
Career  Field. 

Benefits:  Since  70%  of  the  Air  Force  technical 
training  requirement  is  accomplished  through  the 
OJT  program,  the  potential  payoff  of  computer 
support  of  training  and  management  requirements 
within  OJT  is  great.  This  is  especially  true  in  terms  of 
improved  training  quality  and  increased  unit 
capability  to  meet  operational  requirements. 


Title:  Feasibility  of  Low-Cost  CAI/CM!  System 

Description:  The  objectives  of  this  effort  were  the 
definition  and  specification  of  a  low-cost,  computer- 
assisted  instruction/computcr-managed  instruction 
(C.AlAiMI)  system  for  Air  Force  resident  technical 
training.  The  functional  CAlAiMl  requirements 
were  determined  hy  surveying  potential  Air 
Training  Command  user  personnel.  Computer 
architectures  were  then  surveyed  to  identify 
candidate  systems  capable  of  supporting  those 
functional  requirements.  Terminal  hardware  devices 
and  communication  systems  were  also  surveyed  in 
order  to  describe  an  economical  set  of  input/output 
devices  and  communications  interfaces  for  satisfying 
the  functional  requirements.  Additionally,  various 
computer  programming  languages  were  analyzed  to 
determine  the  most  cost-effective  language  for  CAI/ 
CMI  programming.  Finally,  existing  CAI/CM  I 
applications  programs  were  surveyed  to  determine 
the  extent  to  which  they  met  Air  Force  training 
needs  and  to  identify  potential  sources  of 
applications  software  for  the  low-cost  system.  A 
system  specification  was  prepared  to  describe  the 
functional  requirements  and  capabilities  of  the  low- 
cost  system.  Parameters  for  the  low-cost  system  were 
based  on  the  following  assumptions:  (a)  primary 
initial  implementation  will  be  in  resident  technical 
training,  (b)  the  system  will  he  a  dedicated  local 
system  with  a  modular  approach  to  expansion,  and 
(«■)  the  system  will  support  500  students  per  shift,  in 
five  courses  with  1,500  hours  of  instruction  —  10% 
CAI.  and  five  CM  I  transactions  per  student  per  shift. 
The  surveys  of  computer  architectures,  terminals, 
communications,  and  support  software  identified 
candidates  from  these  areas  for  the  low-cost  system. 
A  functional  specification  describing  the 
requirements  for  the  low-cost  CAIAiMI  system  was 


produced.  The  suggested  system  configuration  is 
bast'd  on  currently  available  ( 1 07*>)  hardware  and 
includes  (a)  computer  and  peripherals,  (b)  student 
and  administrative  terminals-alphanumerics. 
graphics/color,  and  high  resolution  graphics,  (c) 
management  terminals  — forms  reader,  printer,  and 
controller,  (d)  programming  language,  (e)  support 
software,  and  (f)  applications  programs.  AF11RL- 
T  R  -  7  0  - 1 2 .  /.  o  tc  -Cost  Computer-Aided 
In  structio  n/Co  m  p  u  te  r -M  imaged  I  ns  true  tio  n 
(C.AI/CMl)  System:  Feasibility  Study, 
documents  this  study. 

Benefits:  This  effort  defined  and  specified  an 

operationally  configured  system  as  constrained  by 
the  stated  parameters  and  costing  approximately 
$500,000.  that  can  support  the  FAIA/MI  functional 
requirements  of  Air  Force  resident  technical 
training. 


Tide:  Formula  don  and  Validation  of  a  Computerized 
Instructional  Adaptive  Testing  Model 

Description:  Testing  is  an  important  aspect  of  any 
training  system.  Since  the  Air  Force  conducts  one  of 
the  largest  training  efforts  in  the  world,  it  must  be 
concerned  with  any  procedure  which  tests  more 
efficiently.  The  theory  and  methodology  of  adaptive 
testing,  developed  largely  in  the  current  decade, 
provide  such  a  procedure.  Basically,  adaptive  testing 
uses  one  of  a  variety  of  possible  algorithms  to  select 
the  next  best  item  to  present  to  the  examinee.  All 
procedures  have,  in  common,  the  fact  that  an  item 
selected  for  presentation  is  based  on  the  unique  set  of 
responses  given  up  to  that  point,  hence  the  term 
■’adaptive."  The  intent  of  the  current  effort  was  to 
develop  and  test  a  new  algorithm  for  adaptive  testing 
holding  promise  for  increased  testing  efficiency. 
Basically,  the  model  uses  various  item  selection 
procedures  and.  based  on  the  accumulating 
responses,  makes  predictions  concerning  items  not 
vet  presented.  Predictions  are  based  on  matching  the 
subject’s  present  response  veetor  to  a  data  base  of 
previously  tested  subjects.  The  matches  so  obtained 
form  the  basis  of  computing  conditional  probabilities 
for  as  yet  unpresented  items.  A  sequential  decision 
procedure  is  then  used  to  assign  mastery  status  based 
on  actual  and  predicted  item  responses.  Several 
parametric  variations  of  the  model  were  explored 
using  simulated  data  sets  and  compared  to  a  control 
version.  The  results  indicated  that  the  model  needed 
approximately  25%  of  the  items  required  by  the 
control  version  while  achieving  smaller  loss  (hotter 
classification  accuracy).  These  results  were 
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Title:  Learning  Strategies  and  Skills  Training 
Program 

Description.  Research  has  doeiitnented  that  most 
students  tend  to  employ  less  than  effective  and/or 
inefficient  methods  for  acquiring.  retaining,  or 
applying  information.  To  acquire  retain,  and 
appropriately  apply  knowledge,  it  lias  become 
evident  that  methods  designed  to  organize 
information  for  presentation  to  learners  are  of 
beneficial,  yet  limited,  effectiveness,  in  contrast, 
strategies  which  the  learner  finds  useful  in 
transforming  information  through  personal  effort 
are  likely  to  he  “owned.  "  and  retained  and  to 
contribute  to  increased  performance  Programmatic 
research  was  initiated  (a)  to  identify  and  compare 
the  effectiveness  of  alternative  learning  strategies 
upon  learner  performance,  (h)  to  incorporate 
effective  strategies  and  interactive  practice  materials 
within  a  systematic  training  program,  and  (e)  to 
empirically  validate  the  performance  of  strategics- 
trained  and  untrained  students.  .Some  of  the 
strategies  included  have  been  (a)  various  mnemonic 
devices,  (b)  imagery  elaboration,  (<■)  paraphrasing, 
(d)  visual  networking,  (e)  goal-setting,  (f)  distraction 
desensitization,  and  (g)  formal  peer  interaction. 
These  findings  are  documented  in  A  Flf  R  l.-TR  -78- 
(>."$.  Systematic  Training  Program  for 
Unhancing  I, earning  Strategies  and  Skills: 


In, ther  Development.  and  V  I  1 1  K  I  -I  K  ■  H-ti  I . 
I  turning  Strategy  'Tram  me  Mat  rials:  I 
Sc  let  ted  S  uhset. 

Ini  tiiri/l  t  i  I  iz'i  t  in  n  Strategics-trained  student- 
performed  17'Y  to  better  than  untrained 

sti  dents  on  technical  subject-matter  achievement 
tests.  !  ow  reading  aptitude  -indent-  achieved  more 
unde'  imagerv  -tra'cgies  than  did  low  reading 
aptitude  controls  under  the  paraphrasing  or  the 
untrained  strategic-  condition.  V  i-ual  networking 
strategies  stud  nt-  scored  of,",,  higher  on  delaved 
.Hi  nlmi)  aehiev  eluent  le-ts  than  controls  ill  the 
untra'iu  d  group  in  most  case-,  high  reading  aptitude 
stud,  its  achieved  more  than  lower  reading  aptitude 
-t  ode  ot  s. 

Henruts:  \rrning  learner-  with  generalizjhlc 

strategies  and  skit-  for  coping  w  ith  large  amounts  of 
technical  information  would  appear  to  he  a  more 
•  annual  and  efficient  approach  than  teaching 
tins! aide  speeitii  subject  matter  content.  The  latter 
approach  produces  a  person  whose  job  effectiveness 
is  largely  dependent  on  specific  content,  fn  contrast, 
a  student  w  ho  has  mastered  learning  skills,  prov  ides  a 
relatively  independent  learner  who  is  in  a  better 
position  to  cope  effectively  and  efficiently  with  job- 
technology  change.  The  Air  Training  l.ommand  is 
considering  the  implementation  of  a  learning 
strategies  training  program  prior  to  formal 
eoucsework  to  increase  student  achievement 


Title:  Ia>w-(.’ost  Terminal  Alternatives  for  Learning 
Tenter  Munagers 

Description.  The  Air  force  Advanced 
Instructional  System  f.AlS).  originally  designed  in 
I V7.T  and  operational  b\  1975,  provides  computer- 
managed  instruction  ((.Ml)  and  computer-aided 
instruction  ((i.AI).  The  interactive  input/output 
device  specified  by  the  original  VIS  contract  and 
used  by  learning  center  managers  and  students  was  a 
plasma  screen  graphics  display  terminal  which 
required  a  special  communication  system  and  a 
communication  protocol  which  was  not  standard  to 
the  industry.  The  AIS  terminal  was  a  very  capable 
device;  however,  the  overall  eost  of  an  instructional 
system  could  he  significantly  reduced  if  the  average 
cost  of  the  interactive  device  is  lowered.  To  provide 
cost-effective  replacement  equipment,  a  review  of 
industry  communications  standards  and  an 
evaluation  of  features  most  available  on  state-of-the- 
art  terminals  was  required.  When  the  industry 
review  was  correlated  with  classroom  functional 
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requirements  and  program  frequency  of  use  in  the 
classroom .  a  set  of  characteristics  could  be  identified 
which  should  he  available  in  the  target  terminals.  To 
lest  the  concept  of  the  new  replacement  system, 
several  of  the  new  terminals  and  related  hardware 
would  have  to  be  procured  and  operated  in  parallel 
with  the  previous  A  IS  graphics  terminals  after 
modifying  selected  software.  An  evaluation  would 
cheek  the  effectiveness  of  the  original  characteristics 
predictions.  Results  of  this  study  will  be  reported  in  a 
technical  report  entitled  Low-Lost  Terminal 
Alternatives  for  Learning  ( '.enter  Managers. 

Impact/l  tilization:  Results  of  the  user-needs 
study  identified  the  required  characteristics  for  a 
low-cost  interactive  terminal  for  use  in  the  ALS. 
These  characteristics  were  in  the  areas  of  display, 
keyboard,  and  transmission  parameters.  An 
additional  constraint,  cost,  was  added  to  the  user 
requirements.  The  resulting  requirements  of  the 
display  were  to  present  in  two  brightness  levels  the 
‘Jh-character  ASCII  erican  Standard  Code  for 
Information  Interchange  set  on  a  format  of  at  least 
24  lines  with  HO  characters  per  line  Also,  an 
addressable  cursor  and  a  single  command  screen 
erase  were  found  to  be  necessary.  The  keyboard  was 
to  have  a  typewriter-line  (QWKRTY)  layout  with 
function  keys  and  a  calculator  format  number  pad. 
Current  system  compatibility  in  addition  to  user- 
oriented  requirements  required  transmission 
parameters  to  include  full  duplet  asynchronous 
character-at-a-time  at  the  rate  of  1 200  bits  per 
second.  A  threshold  for  cost  was  set  at  $1  .500  when  it 
was  found  that  a  large  number  of  terminals 
possessing  the  required  attributes  existed  at  prices 
beneath  this  figure.  Hardware  acquired  for  the 
contract  included  Applied  Digital  Data  Systems 
(.ADDS)  Regent  100  terminals.  Timeplex  202C 
modems,  and  a  Control  Data  Corporation  2551-1 
network  processing  system.  The  (.’.AM  II  language 
was  modified  to  send  octal  values  directly  to  the 
terminals,  and  a  new  operating  system  peripheral 
processor  program  was  written  to  efficiently  control 
the  network  processing  system  and  transmit  data 
between  the  host  Cyber  74 lb  computer  and  the 
terminals.  Lighteen  application  programs  used  by 
Instructors  and  Learning  (.enter  Managers  were 
modified  to  operate  on  the  new  terminal. 

Benefits:  Low-cost  terminals  within  project- 
established  cost  and  characteristics  constraints  were 
identified,  purchased,  and  installed. 
Communications  equipment  necessary  to  interface 
these  terminals  was  also  installed  and  necessary 
software  modifications  made.  The  use  of  a  standard 


terminal  in  parallel  with  the  current  ALS  terminal 
has  proven  both  cost-effective  and  desirable.  The 
diverse  needs  of  the  various  applications  in  a 
complete  CMI/CU  system  seem  to  indicate  that  a 
"ini'  “  of  terminal  tv  pcs  will  alw  ays  be  required.  This 
"mix  ”»hould  lie  considered  in  any  future  expansions 
of  the  AIS.  The  low-c  ost  terminals  in  this  study  met 
the  needs  of  instructors  and  learning  center 
managers.  Surveys  taken  during  the  test  period 
indicated  good  acceptance  of  the  terminal  and  the 
terminal  system  operation. 


Title  :  Operational  Consequences  of  Literary  Cap 

Description ■  This  effort,  using  Air  force  test 
materials  and  low  to  medium  ability  Air  Force 
personnel,  attempted  to  determine  if  discrepancies 
between  personnel  reading  level  and  material 
reading  levels  (literacy  gaps)  affect  text 
comprehension  over  and  above  effects  of  personnel 
reading  level  alone.  An  additional  factor  studied  was 
whether  the  detrimental  effects  of  literacy  gap  can  be 
overcome  by  allowing  extra  reading  time.  Both 
questions  were  answered  affirmatively,  but  elfeets 
were  small. 

Impact/l  tilization:  The  results  of  this  study  can 
be  used  as  a  basis  for  recommendations  about  die 
redesign  of  Air  Force  documents.  They  are  defined 
in  A  F  II  R  I.  -  T  R  -  7  ‘I  -  2  2  .  Operational 
Consequences  of  l  iterary  Cap. 

Benefit:  These  results  suggest  that  before  expensive 
measures  arc  taken  to  eliminate  literacy  gaps  by 
rewriting  documents  or  allowing  personnel  increased 
reading  time,  the  relatively  small  predicted  gain  in 
reader  comprehension  should  be  weighed  carefully. 


Title:  Readability  of  Air  Force  Publications 

Description:  AFR  5-1.  Air  Force  Publication 
M image m  ent  Program  ,  requires  Air  Force  writers 
to  match  the  reading  level  of  their  texts  to  that  of 
their  intended  audience.  The  present  studv 
investigated  whether  rewritten  regulations  submitted 
bv  Air  Force  writers  as  complying  with  AF’R  5-1 
were  actually  comprehensible  to  their  intended 
readers.  The  text  reading  grade  level  (RGL)  for 
regulations  in  seven  Air  Force  eareer  fields  were 
reehecked.  and  appropriate  comprehension  tests  on 
these  texts  were  given  to  field  members.  It  was  found 
that  writers  could  not  bring  the  R <7 1,  of  their  texts 
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down  much  below  I  Ith  grade.  while  the  mean  K < » I . 
of  personnel  in  three  of  the  seven  fields  was  below 
lllth  grade  level.  In  these  eases,  reader 
comprehension  scores  were  below  the  established 
criterion,  indicating  inadequate  comprehension. 
Findings  are  described  in  A  FH  R  I.-TR -70-2  I . 
KriulubilitY  of  lir  For  re  l‘u  b  I  initio  n  s  :  I 
(.rilrrion  Hrfrrrnrrd  I  t  ill ua t  in  n 

Imfini  t/I  tilizntivn :  The  results  of  this  study  have 
been  used  as  the  basis  for  making  recommendations 
and  answering  w  riters'  inquires. 

lirnrfits:  The  results  of  this  study  have  the 
follow ing  implications: 

I  W  riters  of  Air  Force  publications  and 
regulations  should  get  additional  training  in  the  use 


of  the  Ft  tit  (A  ST  formula  and  in  way  to  decrease  the 
|{t;l.s  of  their  tests. 

2.  For  the  purposes  of  FOR  ( .  \  S  I  R  (» I .  estimation, 
lam  i liar  in  nil  is\  liable  w  ords  should  not  be  counted 
as  words  ol  one  syllable. 

.1 .  The  police  of  writing  to  target  audience  should 
be  continued  but  should  not  be  enforced  rigidly, 
(iiven  the  relatively  crude  wavs  cm  pin  v  ed  at  present 
to  estimate  literacy  gap.  it  is  probably  not 
appropriate  to  insist  that  w  rilers  hit  their  targets  with 
a  great  deal  of  precision.  Additionallv.  the  practical 
problems  involved  in  simplifying  materials  below 
I  Oth  grade  level  may  be  insurmountable.  If  these 
suggestions  are  followed.  Air  Force  writers'  tasks  in 
compiling  with  AFR  .>-1  should  become  easier  and 
better  defined,  resulting  in  more  readable 
publications. 
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Tide:  Development  of  Air  Force  National  Skills 
Market  Model 

Desc  ription  :  The  advent  of  the  all  volunteer  force 
has  resulted  in  an  expanding  interest  on  the  part  of 
military  personnel  planners  to  understand  the 
complex  interactions  between  military  personnel 
systems  and  various  economic  forces.  Of  specific- 
interest  arc-  those  force's  which  impact  on  indiv  idual 
decisions  to  enlist  or  reenlisl.  Kvcn  though  a 
considerable  amount  of  research  has  been  completed 
in  this  area,  the  results  have  not  been  particularly 
useful.  Tile  purpose  of  the  current  research  eflort  is 
to  develop  a  computer-based  national  skills  market 
model  for  projecting  Air  Force  enlisted  accession 
and  retention  rates  under  varying  economic-, 
demographic,  and  Air  Force  policy  changes.  The- 
projections  will  include  overall  rates  for  the  Air 
Force  at  large-  and  specific  rates  for  different  levels  of 
occupational  spccialtv  and/or  quality  groupings.  This 
effort  will  he  based  upon,  and  will  extend,  a 
methodology  developed  under  previous  \  III  111. 
sponsored  research. 

Impucl/I  tilizntion:  This  effort  should  refine  and 
transition  the  conceptual  models  developed 
previously  into  a  working  version  implemented  on 
the  AFHRI.  I  MV  AC  I  l(IK  computer.  The  long- 
range  objective  of  the  research  is  to  enable  Vir  Force 
manpower  planner-  to  simulate  the  impact  on  Air 
Force  accession  and  retention  caused  bv  c  hange's  in 
Air  Force  policies,  demographic  conditions  and 
economic  variables.  Once  acquired  and 
implemented,  the  Vir  Force  National  Skills  Market 
Model  will  become  a  general  purpose  tool  for  labor 
market  analvsis.  The  following  organizations  have 
been  briefed  on  this  research  effort  and  have 
expressed  a  real  need  for  applications  of  this  model: 
Officer/K  nlisted  Retention  (  A  F  VI  I’C  A1  I’C M  M  ) . 
Recruiting  Service  (AT(!/RSMY)  and  Airman 
Analysis  It  ranch  (AFM PC/M  I’X  AA). 


Title:  Development  of  Improved  Methods  for 
1‘ie  die  ting  Involuntary  Separation 

Description:  In  response  to  a  request  for  personnel 
research  (RI’R  77-1  i)  a  study  was  initiated  in 
November  I  *>77  to  compare  the'  classification 
accuracy  of  several  prediction  methodologies  dealing 
with  binary  criteria.  Included  were  the  Motivational 
Attrition  Prediction  (M  AP)  method,  ordinary  least 
squares  regression .  standardized  regression,  and 
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Bayesian  classification.  During  Fiscal  year  D)78. 
efforts  (‘entered  on  comparing  the  classification 
accuracies  of  the  methodologies  in  identifying  first- 
term  airman  involuntary  dischargees.  Those  results 
were  documented  in  A  f  H  K  F-TH  -7^-ott.  Predicting 
I  n  t  oluntary  Separation  of  Enlisted  Personnel. 
During  Fiscal  Year  l‘)7<).  comparisons  were'  made 
using  other  hinarv  criteria  including  graduation/ 
elimination  from  technical  training,  basic-  military 
training,  and  undergraduate-  pilot  training.  A  draft 
technical  report  /-,  i  aluatia  n  of  the  Capabilities  of 
•Secern/  Computerized  Algorithms  to  Prediet 
C  roil notion  from  I  arums  Types  of  1  ir  Torre 
Training,  describing  the  results  has  been 
completed. 

/  m  par  t/C  tilizatio  n  :  Various  Air  Force  agencies 

(suc  h  as  VF/DPWO  A.  AFM  PC/DPM  M  A.  and 
ATC/RSM  )  concerned  with  the  problem  will  use  the 
results  of  this  research  for  the  development  of 
improved  selection  standards  for  initial  obligated 
tour  of  duty  and  various  types  of  training  programs. 
The  results  could  also  be  generalized  to  improve 
prediction  in  other  areas  of  the  personnel  system 
suc  h  as  promotions  and  retirements. 


Title  :  Development  of  On-the-job  Training  Capacity 
Model 

Description:  As  budgetary  considerations  force 

program  restrictions  in  the  Air  Training  Command, 
much  of  the-  training  previously  conducted  in 
resident  courses  is  moved  into  the  On-the-job 
Training  (OJT)  setting.  When  field  supervisors 
become  responsible  for  additional  training  over  and 
above  their  operational  mission,  the  danger  exists 
that  quality  of  training,  mission  performance,  unit 
readiness,  or  all  of  these,  may  suffer.  The  Air  Force 
lacks  a  quantifiable  model  for  determining  the 
relationships  between  these  outcome  variables  and 
the  amount  of  OJT  conducted  in  various  units. 
Optimum  training  load  in  OJT  is  being  studied  in 
this  context.  Attempts  arc  being  made  to  specify,  in 
objectively  measurable  terms,  the  factors  which 
impact  a  unit’s  capacity  to  conduct  OJT  without 
mission  requirements  being  impaired.  Training  load 
is  conceptualized  as  the  residual  when  resources 
devoted  to  mission  accomplishment  arc  subtracted 
from  total  resources  (i.c..  manpow<  equipment, 
etc.)  available  to  a  unit.  It  is  hoped  that  more  precise 
and  measurable  definitions  of  these  factors  ran  be 
formulated. 


Im par ttV tilization:  When  the  eapaeity  model  is 
developed,  demonstrated,  and  validated.  Air  Staff 
and  Air  T raining  Command  managers  will  be  able  to 
make  more  objeetively  verifiable,  data-based 
derisions  with  regard  to  whether  a  rourse  of 
instruction  should  be  taught  in  residence  or  in  the 
OJT  program. 


Title :  Development  of  Testing  and  Instructional 
System  based  on  Micm terminal  and  Microfiche 
Devices 

Description:  Prior  research  (reported  in  AFHRL- 
TR -78-50,  Development  of  a  Low-Cost.  Stand ? 
Alone  Microterminal  for  Support  of  Testing 
and  Instruction)  showed  that  the  use  of  a  small, 
inexpensive  stand-alone  terminal  could  he  used  to 
support  testing  in  a  computer-based  system  such  as 
the  Advanced  Instructional  System.  The  advantage 
of  such  a  terminal  is  both  instructional  and 
economic.  Results  to  date  indicate  that  the  process  of 
answering  test  questions  using  the  microterminal 
rather  than  computer-readable  test  forms  affects  the 
speed  and  accuracy  with  which  students  complete  a 
test.  Over  an  appropriate  amortization  period,  such 
as  5  years,  a  capital  investment  in  low-cost  terminals 
would  effect  a  savings  over  the  recurring  material 
costs  associated  with  test  forms.  The  present  research 
effort  is  directed  toward  extending  the  knowledge 
base  about  a  new  technology  such  as  the 
microterminal.  A  basic  design  assumption  for  the 
microterminal  was  that  computing  power  be  focused 
on  student  responding  rather  than  the  presentation 
of  information.  It  was  felt  that  for  most  instructional 
purposes,  the  presentation  of  information  could  be  as 
effectively  handled  by  more  traditional  means  of  off¬ 
line  presentations  such  as  programmed  texts. 
However,  the  powerful  instructional  technique  of 
branching  becomes  difficult  to  implement  with 
printed  materials.  For  this  reason,  the  two- 
dimensional  accessibility  feature  of  microfiche  is 
seen  as  desirable.  Additionally,  in  a  large  computer- 
based  instructional  system,  the  production  of 
microfiche  materials  is  a  very  direct  process  through 
the  use  of  Computer  Output  Microfiche  (COM). 
COM  production  techniques  were  studied  under  a 
just  completed  AFHRL  effort,  and  the  findings 
showed  that  COM  was  a  feasible  training  technology. 
Conduct  of  the  COM  research  was  performed  in  the 
Weapons  Mechanic  Course  at  the  Lowry  Technical 
Training  Center.  The  essence  of  the  present  effort  is 
to  combine  the  computer  technology  of  the 
microterminal,  which  focuses  on  the  control  of 
student  responding,  and  microfiche  technology. 


which  provides  ready  access  to  diverse  frame  of 
instructional  information.  A  hardware  interface 
allows  the  m  icrolerir.  inal  to  "know  ''  w  hich 
microfiche  frame  is  being  used  by  the  student.  In 
turn,  the  microterminal  contains  the  intructional 
logic  which  directs  the  student  through  the  frames  of 
information  on  the  microfiche.  To  be  demonstrated 
at  the  end  of  this  effort  is  a  low-cost  form  of 
co m puter-assisted  instruction  and  testing.  In 
addition  to  the  hardware  development,  much  effort 
will  be  devoted  to  the  pragmatics  of  designing  and 
developing  instructional  and  testing  materials  for  the 
microterminal/microfiche  system  with  an  emphasis 
on  process.  The  effort  is  directed  toward  designing  a 
complete  packaged  system. 

I m pac t/V tilization  :  Although  the  Microterminal/ 
M  icrofiche  System  is  only  at  the  prototype  stage,  it  is 
seen  that  fully  operational  units  could  be  used  in 
both  resident  and  field  training  courses,  for  support 
of  Kx tension  Course  Institute  (ECI)  materials,  and  in 
large-scale  testing  operations,  such  as  enlistment 
testing.  Presently,  plans  are  being  made  to  support 
block  level  testing  in  a  resident  course  at  l.owry 
A F B .  The  potential  benefits  of  this  technology  are 
the  reduction  of  computer  form  costs  for  computer- 
based  instruction,  provision  of  interactive 
instruction  for  either  computer  or  manually 
managed  individualized  courses,  reduction  in 
instructional  materials  costs  through  utilization  of 
micrographics  technology,  and  increased  testing 
capabilities,  including  test  security. 


Title:  Evaluation  of  Standardized  Position  Oriented 
Training  System 

Description:  In  recognition  of  the  need  to  devote 
more  management  attention  to  on-the-job  training 
(OJT).  the  Air  Force  contracted  for  a  large-scale 
systems  analysis  of  the  OJT  program,  which  was 
completed  in  December  1975.  One  of  the  problem 
areas  indicated  by  this  analysis  was  that  training  tasks 
were  not  clearly  defined.  The  most  vital  step  in 
developing  any  training  program  is  the  identification 
of  requirements.  I  nless  these  requirements  are 
precisely  and  clearly  spelled  out.  it  is  nearly 
impossible  to  develop  a  viable  program.  The 
Specialty  Training  Standard  (STS),  which  is 
presently  used  to  develop  the  OJT  Job  Proficieney 
Guide  (JPG),  in  many  cases  is  much  too  general  to  be 
used  as  a  task  list  for  OJT.  It  is  satisfactory  as  a  basic 
document  for  development  of  Career  Development 
Courses  (CDCs),  technical  training  courses,  and 
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Specialty  Knowledge  Tests  (SK  IV):  however,  it 
laiks  the  specificity  required  lor  task  training.  HO 
I  SAF  is  experimenting  with  a  new  position-oriented 
approach  to  On-the-Joh  Training  called  SPOT 
(Standardized  Position  Oriented  Training). 
According  to  present  plans,  occupational  survev  data 
will  he  used  to  sided  required  tasks  and  identify  joh 
types.  OJT  will  then  he  required  for  those  tasks 
associated  with  the  particular  joh  type  to  which  a 
trainee  is  assigned.  AFHKI.  is  developing  new  wavs 
of  organizing  occupational  survey  data  so  that  they 
can  he  used  to  design  various  characteristics  of  the 
SPOT  system.  The  end  product  of  this  effort  will  he  a 
set  of  strategies  and  related  software  for  development 
of  position  specific  task  listings.  A  subsequent  task 
will  he  to  evaluate  the  strategies  for  extracting  task 
listings  from  the  occupational  data  base  in  terms  of 
utility  in  the  field. 

Impart/I  tilizalion :  This  efftWt  will  provide  the 
Air  Force  with  a  method  of  developing  clearly 
defined  OJT  training  requirements  for  each  joh  type 
within  every  Air  Force  Specialty  Code.  The  OJT 
trainer  w  ill  have  a  more  definitiv  e  set  of  job-specific 
tasks  with  which  to  train  and  evaluate  training 
results.  The  results  should  be  a  more  efficient 
training  system  and  a  better  system  for  tracking  of 
training,  especially  for  personnel  after  a  permanent 
change  of  station. 


Title :  Handbooks  and  Model  Specifications  for  the 
Design  and  Development  of  Maintenance 
Simula  tors 

Description:  The  objective  of  this  study  is  to 

collect.  analy7.e,  and  document  data  in  order  to 
develop  a  set  of  introductory  handbooks  for 
Instructional  System  Development  (ISD)  teams  and 
Training  System  Acquisition  managers  involved  in 
requirements  development,  design,  and  procurement 
of  maintenance  simulators.  In  addition,  this  effort 
requires  the  development  of  model  functional 
specifications  for  the  design  of  both  organizational 
and  intermediate  level  maintenance  training 
simulators  for  utilization  in  resident  school  and  field 
training  environments.  The  six-step  approach  that 
will  he  used  involves  the  collection,  analysis,  and 
documentation  of  information  on  the  design, 
fabrication,  and  life-cycle  maintenance  of 
maintenance  simulators.  This  research  is  being 
conducted  by  a  civilian  contractor  through  a  process 
of  information  requirements  analysis  to  include  (a) 
development  of  techniques  and  decision  aids  based 
upon  an  analysis  of  maintenance  task  classifications 
and  (b)  development  of  guidelines^tandbooks  and 


model  specifications  which  incorporate  the 
preceding  data  collection  and  analysis.  The  ISD 
handbook  is  expected  to  specify  procedures  for  (a) 
determining  the  most  effective  mix  of  training 
equipment  (trainers  primarily  used  bv  students  to 
practice  reuired  lask/part-task  activities)  for  at !  types 
of  maintenance  training  requirements,  (b) 
prescribing  the  most  appropriate  design  features  and 
characteristics  of  maintenance  simulators  as  a  class  of 
trainers,  and  (c)  documenting  maintenance 
simulator  design  so  that  it  can  be  efficiently 
translated  by  a  System  Program  Office  (SPO) 
Training  Device  Acquisition  Manager  into  a 
procurement  specification  with  the  aid  of  the  SPO 
handbook. 

Im  pact/l'  tilizalion :  It  is  anticipated  that  the 
resultant  documents  will  be  use  to  ISD  teams  during 
the  development  of  training  specifications  for 
maintenance  simulators  and  to  the  SPO  activities  in 
the  translation  of  these  training  requirements  into 
equipment  specifications  in  such  a  wav  that  efficient 
and  effective  training  devices  will  result. 


Title:  Instructional  Model  for  Task  Oriented, 
Performance  Based  Content 

Description:  The  first  and  perhaps  most  important 
aspect  of  instructional  design  is  the  determination  of 
what  needs  to  be  taught.  Most  task  analysis 
procedures  are  adequate  in  identifying  the  specific 
task  or  task  element  but  fail  to  give  much 
specification  to  the  underlying  content.  The  present 
effort  will  attempt  to  synthesize  factors  derived  from 
the  areas  of  human  information  processing,  problem¬ 
solving.  cognitive  structures  and  styles  and 
individual  differences  so  as  to  develop  an 
instructional  model  for  task  oriented,  performance 
based  instruction.  The  emphasis  of  the  model 
development  will  be  the  representation  of  knowledge 
through  instructional  content  based  on  cognitive 
functioning  in  task  specific,  performance  based 
contexts.  This  effort  will  address  the  issue  of  how  to 
determine  individual  (earning  requirements  in 
criterion  based  individualized  instructional  systems. 

Impact/U tilizalion:  Successful  results  from  the 
evaluation  of  this  model  would  lead  to  the  utilization 
of  this  model  for  the  formulation  of  specific 
procedures  for  conducting  content  analysis 
subsequent  to  task  analysis  in  the  Instructional 
System  Development  process.  Better  content 
analysis  will  lead  to  more  efficient  instruction 
through  the  elimination  of  unnecessary  instruction 
or  better  sequencing  of  instruction. 
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Ti  lit*  :  Inte  rs  e  rvic  e  Computerized  Adaptive 
Performance  K valuation 

Description  :  The  Air  Force  conducts  and  evaluates 
technical  training  in  a  criterion-referenced  mode. 
That  is  to  say.  trainees  are  evaluated  during  training 
relative  to  a  specified  performance  standard  rather 
than  to  each  other  (norm-referenced).  ^  hile  the 
concept  and  utilization  of  criterion-referenced 
testing  has  been  available  for  some  time,  theoretical 
developments  have  been  meager  due  to  the  general 
popularity  of  norm -referenced  testing.  The  current 
research  effort  reflects  the  AFHRI.  portion  of  the 
joint-funded,  tri-service  (AFHRI.,  Office  of  Naval 
Research.  Arms  Research  Institute)  computerized 
adaptive  performance  evaluation  project.  The 
objectives  of  this  project  are  (a)  to  develop  a  formal 
psychometric  basis  for  the  construction, 
dev  elopment,  and  evaluation  of  criterion-referenced 
cognitive  and  performance  tests,  (b)  to  apply  the 
psychometric  foundation  to  the  construction  of  item 
pools  for  criterion-referenced  testing  in  two  or  more 
content  domains,  (c)  to  adminster  computerized 
adaptive  criterion-referenced  tests  based,  on  those 
item  pools  to  Air  Force.  Navy,  and  academic 
populations,  (d)  to  evaluate  the  adequacy  of  the 
resulting  test  scores  for  both  formative  and 
summalive  evaluation  problems  with  various 
criterion  parameters,  and  to  evaluate  the  adequacy  of 
the  theoretical  rationale  proposed,  (e)  to  develop 
and  refine  the  computerized  adaptive  performance 
simulation  test,  (f)  to  develop  a  taxonomy  of  major 
problem-solving  modes  relevant  to  generalized 
learning  outcomes,  and  (g)  to  develop  the 
psychometric  methodology  and  integrate  it  with 
computer  technology  necessary  to  measure  the  major 
varieties  of  performance  identified  in  earlier  of  the 
research. 

/ m  pat  l/l  tilizatio  n  :  The  results  of  this  effort  hold 
considerable  promise  for  conducting  Air  Force 
testing  more  efficiently  with  greater  precision  and  in 
considerably  less  time.  A  FH  R  I.  plans  >■  implement  a 
portion  of  the  results  obtained  to  date.  i.e..  adaptive 
achievement  testing,  in  a  technical  training  course  at 
l.owry  AFB. 


Title  :  Kalman  Hite  r  Pn-diction  of  Time  Series  Based 
on  Stale  Space  Models 

Description:  Time  series  analysis  is  a  vital 

statistical  tool  in  many  areas  of  personnel  research 
where  regression  analysis  is  not  appropriate. 
Through  a  contract  with  Scientific  Systems.  Inc.. 
AFHRI  will  gain  the  general  ability  to  make  use  of 


time-series  prediction  with  slate  space  forecasting 
Prediction  models  will  be  developed  for  a  subset  ot 
variables  in  the  person-joh-inatrh  fl’JM  )  system  and 
for  the  re-enlistment  rates  for  selected  enlisted  skills 
AFHRI.  will  procure  a  generalized  computer 
program  for  developing  state  space  forecasting 
models  and  will  hold  two  short  courses  for  training 
analysts  in  state  space  modeling. 

Impact! I  tilization:  Application  of  Kalman 

Filtering  in  personnel  research  using  -tale  space 
input  models  will  greatly  improve  prediction 
accuracy  in  areas  where  regression  techniques  are 
not  applicable.  Kalman  Filtering  is  a  powerful 
estimation  technique  in  engineering  and  aerospace 
technology.  I  bis  effort  will,  for  the  first  time,  apply 
this  technique  to  behavioral  science  research 
allowing  AFHRI.  to  expand  its  technical  base  to 
become  the  first  Department  of  Defense  organization 
with  state  space  forecasting  capability. 


Title:  Methodology  for  the  Identification, 
Development,  and  Evaluation  of  Instructional 
Tn-atmenls 

Description:  The  development  of  the  Advanced 
Instructional  System  (  A I S )  at  l.owry  AFH  resulted, 
in  part,  in  an  unparalleled  operational  computer- 
managed  instruction  system  with  the  capability  of 
implementing  and  evaluating  instructional  strategies 
designed  to  affect  training  outcomes.  It  is  a  common 
and  appropriate  assumption  that  good  instruction 
caters  to.  and  capitalizes  on.  strengths  and 
weaknesses  of  the  learner.  To  the  extent  that  this  is 
true,  the  instructional  process  is  optimized.  This 
optimization  affects  both  the  quality  of  instruction 
and  the  time  required  to  reach  mastery.  The  adaptiv  e 
model  component  of  the  A  I S  was  designed  to  permit 
this  type  of  optimization:  however,  substantial 
methodological  questions  concerning  strategy 
development  and  implementation  remain.  Namely, 
(a)  the  identification  of  instructional  units  for  which 
alternate  instructional  strategies  are  potentially 
appropriate,  and  for  which  training  time  savings 
would  be  significant,  (b)  the  identification  of  those 
cognitive  skills  and/or  affective  measures  which  are 
related  to  the  instructional  unit,  (e)  the  translation  of 
the  identified  skills  into  an  instructional  module(s) 
which  in  fact  enhances  performance  for  the 
identified  subpopulalion.  and  (d)  the  development  of 
evaluation  parameters  for  establishing  strategy 
validity. 

/m  par  til  lilizalio  n :  The  results  of  this  research 
effort  will  be  documented  in  a  handbook  appropriate 


for  utilization  by  Air  Force  and  other  Department  of 
Defense  instructional  specialists  for  designing, 
implementing,  and  evaluating  instructional  strategies 
aimed  at  increasing  instructional  quality  and 
reducing  training  time,  thus  reducing  training  costs. 


Title:  Simulator  Training  Requirements  and 
Effectiveness  Study  (STRES) 

Description:  The  basic  objectives  of  the  Simulator 
Training  Requirements  Effectiveness  and  Study 
(STRES)  are  to  define,  collect,  analyze,  and  present 
data,  findings,  and  conclusions  relevant  to  the  eost 
and  training  effectiveness  of  each  important 
characteristic  of  aircrew  traiing  devices  (ATI)).  To 
accomplish  these  objectives,  the  study  has  been 
structured  around  the  following  goals:  (a)  develop 
criteria  for  matching  training  requirements  with 
ATI)  features  and  fidelity  considerations,  (b)  define 
principles  of  effective  and  efficient  utilization  of  the 
ATI)  w  ithin  the  context  of  total  training  sy  stems,  (c) 
develop  criteria  for  matching  instructional  features 
and  techniques  with  specific  training  requirements, 
and  (d)  identify  cost  factors,  models,  and  data  which 
influence  the  total  cost  and  worth-of-ownership  of 
ATDs.  This  effort  is  being  accomplished  with  both 
contract  and  in-house  resources  and  has  the  active 
participation  of  an  advisory  team  composed  of 
members  of  each  of  the  Air  Force  major  commands, 
the  Army,  and  the  Navy,  as  well  as  procurement  and 
research  and  development  agencies.  Current 
estimated  expenditure  for  ground-based  ATDs 
exceeds  a  billion  dollars  over  the  next  few  fiscal 
years.  In  the  current  and  expected  climate  of 
restricted  spending,  coupled  with  the  constant 
requirement  to  maintain  operational  force  readiness, 
valid  information  must  be  available  to  allow 
management  and  user  trade-off  decisions  regarding 
training  capability  versus  cost.  In  addition,  such  data 
must  allow  maximization  of  already  existing  devices 
within  the  inventory  and  currently  on  order.  Such 
data  may.  in  large  measure,  be  provided  by  this 
study. 

Impact/l' tilization:  It  is  anticipated  that  the 

primary  users  of  this  study  will  be  management  and 
operational  personnel  tasked  with  the  use  of  ATDs  to 
achieve  and  sustain  operational  readiness.  Phase  II  of 
this  study,  whi:  it  summarizes  and  presents  data  based 
on  the  current  technical  data  base  and  operational 
experiences  will  be  completed  in  January  D)8<).  A 
series  of  seven  technical  reports  documenting  this 
effort  will  be  published.  One  of  these  reports  will 
contain  a  research  plan  for  a  follow-on  phase  (III)  of 
th  is  program.  Phase  III  is  planned  as  a  research 


activitv  to  provide  additional  training  information 
on  important  simulator  utilization  questions  that 
cannot  be  answered  without  experimental  evidence. 
These  studies  will  result  in  specific  data  and 
recommendations  pertaining  to  the  cost  and  training 
effectiveness  of  various  aspects  of  simulators  to  allow 
trade-offs  to  be  made  between  desired  training 
capabiiilv  and  system  operation/life  cycle  costs.  Such 
information  can  make  a  significant  contribution  to 
effective  and  efficient  simulation  training. 


Title:  Team  Training  for  Command/Control/ 
Communications  Operators 

Description:  Operation  of  virtually  all 
sophisticated  Commands.  Control,  and 
Com m  unication  (C  )  and  ground-based  missile 
systems  within  the  Air  Force  requires  coordination 
of  information  input,  decision-making,  and  svstem 
output  among  multi-individual  teams  or  crews. 
Acquisition  and  maintenance  of  team  or  crew  skills 
necessary  to  operate  C  and  ground-based  missile 
systems  at  high  levels  of  profiriency  are  therefore 
essential  elements  in  their  successful 
implementation.  This  study  is  the  initial  effort  in  a 
planned  R&  I)  program  whose  major  goal  is 
improvement  of  the  technology  for  providing  team 
training  (T~)  to  operators  of  these  C  systems.  This 
study  will  develop,  refine,  and  evaluate  optimal 
training  and  simulation  technology  along  five 
implementing  objectives.  These  are  (a)  identification 
and  characterization  of  the  needs  for  and  the  factors 
that  influence  C  T'  programs,  (b)  identification  of 
V.  T  problem  areas  that  require  further  research  for 
solutions,  (e)  development  of  methods  to  address 
major  problems  in  C  T'  that  can  be  solved  with 
current  technology,  (d)  application  of  the  methods 
developed  to  operational  C  T‘  programs  for  purposes 
of  evaluation,  and  (e)  development  of 
recommendations  regarding  potential  utility  of 
simulation  technology  in  CT‘  and  development  of 
preliminary  functional  design  characteristics  of 
potential  simulation  systems. 

Im pact/V tilization:  It  is  expected  that  this  study 
will  serve  as  one  primary  source  of  data  for 
identification  of  specific  training  areas  critical  to  ('. * 
system  operation.  These  critical  areas  will  be  the 
subject  of  future  efforts.  The  immediate  impact  of 
this  effort  will  be  development  of  optimal  training 
and  simulation  technology  to  increase  proficiency  of 
<•  teams  with  possible  reduction  in  the  costs  of 
providing  such  training. 


Ill  M  W  FACTORS  IKCIINOMX, V 


Title:  0  {impute  r-Ba s  e  cl  A1 a  inte  nu  nee  Aids  for 
Technicians 

Description:  The  increasing  complexity  of  \  i  r 
force  weapons  systems  has  resulted  in  a  greatly 
increased  need  for  technical  data.  As  a  result,  the 
number  of  pages  of  technical  orders  required  to 
provide  technical  data  has  increased  greatly.  The 
huge  volume  of  technical  data  is  overloading  the 
already  rumhersome  paper-based  technical  order 
system.  The  problem  is  further  compounded  by  the 
increased  use  of  newer  ty  pes  of  technical  data,  such 
as  job  guide  manuals,  which  have  been  shown  to 
improve  the  efficiency  of  maintenance  personnel, 
hut  these  types  of  technical  orders  require  more 
pages.  An  economical,  non-paper-based  method  tor 
storing,  updating,  and  distributing  technical  orders  is 
urgently  needed.  A  computer-based  system  has  the 
potential  for  meeting  this  need  The  objective  of  this 
project  is  to  develop,  demonstrate,  test,  and  evaluate 
a  prototype  computer-based  system  to  meet  this 
need.  The  emphasis  in  developing  the  prototype 
system  will  he  placed  upon  designing  a  system  that  is 
easy  to  use  and  that  enhances  the  technician's 
performance.  The  prototype  system  will  include  an 
electronic  display  device  (CRT/plasma).  a  mini- 
conipuler/micro -processor,  and  a  storage  device.  Off- 
the-shelf  components  will  he  used.  Specialized 
software  will  he  developed  to  control  the  retrieval 
and  display  of  the  technical  data.  \  Tier  the  prototype 
is  developed,  technical  data  for  a  representative  test 
bed  system  will  he  placed  upon  the  prototy  pe  system. 
The  effectiveness  of  the  prototype  will  then  he 
evaluated  by  measuring  the  performance  of 
technicians  using  data  presented  by  the  prototype 
system  to  maintain  the  lest  bed  system.  The  study 
will  evaluate  the  feasibility  and  desirability  ol  an 
automated  technical  order  sy  stem  and  will  define  the 
requirements  for  an  effective  system. 

Im  puct/l  tiliziition:  The  prototype  system, 

specifications,  and  lessons  learned  in  the  evaluation 
will  he  used  by  the  Air  force  Logistics  Command  in 
the  development  of  the  computer-based  technical 
order  system  for  operational  use  throughout  the  Air 
Force.  This  program  will  contribute  to  reducing  the 
cost  of  maintaining  weapons  systems  by  improving 
the  efficiency  of  Air  Force  maintenance  technicians 
and  hv  reducing  the  cost  of  maintaining  the  Air 
Force  technical  order  system. 


rule:  Human  Resources  in  Weapon  System 
Acquis  ition 

Description:  Lite  purpose  of  t h i -  project  is  to 

provide  a  technology  capable  ol  predicting,  early  in 
tile  weapon  system  acquisition  cycle,  the  life  cycle 
cost /h ti ni a n  resource/svstem  support  impacts  ol 
alternative  weapon  system  designs  and  support 
concepts.  In  the  past,  weapon  systems  have  been 
designed  with  little  attention  devoted  to  support  ol 
tile  system  in  the  field,  largely  because  little 
definitive  information  was  available  early  in  the 
system  design  as  to  the  effects  of  alternative  designs 
on  system  supportabililv .  With  the  costs  of  system 
operation  and  support  approaching  ffO"«  of  the  life 
cycle  costs  in  some  systems  and  with  the  costs  of  the 
human  resources  associated  with  the  weapon  system 
being  approximately  ."»<>"«  of  the  systems  life  cycle 
costs,  designers  must  he  provided  with  the 
information  necessary  to  control  life  cycle  costs 
through  the  design  of  the  weapon  system.  This  will 
he  accomplished  by  integrating,  validating,  and 
demonstrating  a  number  of  techniques,  separately 
developed  and  validated  by  A  I'll  K  I . .  into  an 
integrated  technology  for  planning  the  human 
resource  element  of  a  weapon  system.  The  resulting 
integrated  technology  will  provide  timely  feedback 
of  the  life  cycle  costs  of  alternative  weapon  systems 
designs  early  enough  in  the  acquisition  cycle  to 
provide  decision-makers  the  opportunity  to  consider 
human  resources  life  cycle  costs  in  the  design  of 
weapon  systems.  The  approach  is  to  integrate,  apply, 
and  test  the  technologies  that  A  FURL  has  developed 
in  the  areas  of  (a)  including  human  resources  and 
personnel  costs  as  parameters  in  design  studies,  (h) 
forecasting  and  controlling  manpower  requirements 
through  the  application  of  systems  analysis  and 
computer  modeling  techniques,  (c)  improved 
technical  data  for  maintenance  personnel,  (d) 
training  requirements  analysis  and  advanced 
training  techniques,  and  (e)  system  ownership 
costing.  The  project  is  conducted  in  close 
cooperation  with  the  System  Program  Office  for  the 
Advanced  Medium  Short  Takeoff  and  Landing 
Transport  and  with  the  Aeronautical  Systems 
Division  Deputy  for  Avionics  Control.  Air  Force 
Systems  Command. 

Im pact/I' tiliziition:  This  research  should  have  a 
significant  impact  on  the  methods  used  to  design,  and 


on  llit*  artujl  d«**i£ii  of.  futuro  weapon  systems.  It  will 
also  affert  the  weapon  system  development  approval 
evele.  as  different  information  requirements  and 
trade-off  stmiv  results  will  he  required  for  system 
approval  to  proreed  at  major  Uelense  Systems 
\rqiiisition  Keview  (iotint'il  reviews.  The  results  of 
this  research  ran  he  used  hy  System  Propram  Olfiees. 
\ir  l.opisties  Teniers,  weapon  svstem  eontraetors. 
and  others  involved  in  the  desipn  and  major 
modilieation  of  weapon  systems. 


Title :  liOgistses  and  Human  Resomves  Data  Base 

Description:  A  computerized  lopisties  and  human 
resource's  (HR)  unified  data  hast*  (l  DR)  w  m  i>.- 
dev eloped  to  support  tli<‘  weapon  system  (IX  S) 
design  proeess.  Fxamplcs  oflogisties  and  lilt  data  are 
maintainability  (crew  size,  repair  time,  skill  level, 
shift  manning):  maintenanee  tasks  (calibrate, 
remove  and  replace,  adjust/align,  troubleshoot,  test/ 
inspect):  reliability  (mean  flying  hours  and/or  sorties 
and/or  ground  time  between  failures  and/or 
maintenanee  actions):  support  equipment 
requirements  (test  equipment,  tools,  jigs,  auxiliary 
power) . 

Import/ 1  tiUzatuin:  Consistent  utilization  of  the 
l  I ) It  hv  the  Aeronautical  System  Division,  the  Air 
Force  Test  and  Kvaluation  Center,  the  Air  Force 
Acquisition  l.ogisties  Division,  and  the  aerospace 
companies  will  assure  that  the  logistics  and  HR  data 
being  used  are  consistent  throughout  the  life  of  the 
VS.  Also,  the  I  DB  will  make  logistics  and  HR  data 
av  ailahle  to  the  designers,  managers,  logisticians,  and 
engineers  at  an  earlier  stage  of  the  ^  S  design 
proeess.  This  will  allow  logistics  and  HR  factors  to 
impact  design  to  a  much  larger  degree.  Significantly 
reduced  logistics  and  HR  costs  throughout  the  ^  S 
life  should  result. 


Title  :  Identification  and  Analvsis  of  Factors 
Influencing  the  Performance  of  Air  Force 
Maintenance 

Dew  Tiftlum  Certain  conditions  facing  the  nation 
lodav  are  being  felt  severely  in  the  performance  of 
duties  in  the  Air  Force  aircraft  and  missile 
maintenanee  career  fields.  Inflation,  high  personnel 
costs,  technological  advances,  personnel  turnovers 
and  reductions,  and  the  basic  capabilities  of  the  new 
Air  Force  recruits  have  combined  to  severely  impact 
the  performance  of  maintenanee  jobs.  Although 
maintenanee  consumes  nearly  2.r>%  of  all  Air  Force 
manpower  and  nearly  .'>0%  of  the  Air  Force  budget, 
few  research  dollars  are  being  spent  to  improve  the 


actual  accomplishment  of  maintenance.  Further,  no 
real  basis  exists  for  developing  a  maintenance 
research  program,  because  the  factors  which  impact 
maintenance  performance  an1  not  known.  This  new 
research  effort  will  identify  the  factors  which 
influence  maintenanee  performance  in  both  aircraft 
and  missiles.  The  interrelationship  among  and 
between  factors  will  he  prioritized  in  terms  of  the 
greatest  impact  oil  performance.  Another  phase  of 
the  program  will  develop  a  long  range  maintenance 
research  plan,  based  upon  till-  factors  having  the 
greatest  impact  upon  performance.  Another  product 
will  he  a  plan  to  apply  existing  technology  to  help 
alleviate  known  problems.  Data  will  he  collected  via 
individual  interviews  and  questionnaires  at  a  variety 
of  Air  Force  bases  and  at  all  levels  of  maintenance 
from  technicians,  supervisors,  and  managers. 
Separate  research  programs  will  result  from  the  long 
range  research  plan. 

I  lilizatio n  :  The  results  of  this  research  w  ill  he  used 
hv  research  personnel  to  build  specific  research 
programs  to  improve  maintenance.  Information 
resulting  from  the  research  is  also  expected  to  be 
used  hv  maintenanee  managers  at  all  levels  of 
command  to  influence  policy  decisions. 

Benefits :  The  Air  Force  is  expected  to  increase 
both  the  efficiency  and  the  effectiveness  of  its 
maintenanee  personnel  in  aircraft  and  missiles  as  a 
direct  result  of  this  research.  The  long  range 
maintenance  research  plan  resulting  from  this 
research  will  guide  the  allocation  of  limited  research 
dollars  into  the  areas  where  payoffs  are  most  likely 
and  improvement  most  required.  The  end  result  will 
he  improvement  in  the  effectiveness  of  maintenanee 
personnel,  the  efficiency  of  the  work  force,  the 
nature  of  the  maintenance  environment,  the 
acceptability  of  maintenance  as  a  career,  and  the 
overall  readiness  of  the  aircraft  and  missile  forces. 


Title :  Write  rs  Aid  Computer  Program 

Description:  This  effort  will  produce  a  FORTR  AN 
program  which  accepts,  as  input,  text  typed  into  a 
computer  and  outputs  a  variety  of  information  useful 
to  writers  and  others  concerned  with  the  readability 
of  Air  Koree  documents.  The  program  is  designed 
speeifieally  for  Air  Force  tests  and  provides  four 
readability  estimates,  three  of  which  were  validated 
on  military  material,  as  well  as  text  parameters  (e.g.. 
mean  words  per  sentence).  The  program  will 
additionally  print  out  “problem  aspects"  (e.g..  overly 
long  sentences)  of  a  given  text  and  will  automatically 
generate  CI.OZF.  comprehension  tests  so  that 


■  >.» 


formula  estimates  ean  lie  supplemented  with  tile 
aetual  eoinprehension  scores  of  personnel. 
Additional  features  will  he  added  as  suggested. 

Impnvt/l  tilization :  This  program  will  enable  the 
automated  evaluation  of  the  texts  of  Air  Force 
writers  who  are  complying  with  AFB  ."i-l.  fir  Foret' 


I'll  hlicntio  n  s  \1  inopcm  ent  I'rnprnm  and  will 
allow  writers  to  train  themselves  to  create  more 
readable  and  comprehensible  tests.  It  is  seen  as 
particularly  useful  to  writers  of  regulation-  and  to 
curriculum  dev  elopers 


MANPOWER  AND  PERSONNEL  M AN A( , E.M ENT 'IKC H N 0I,( M . V 


Title:  Development  of  Maintenance  Metrics 

Description:  The  manpower  and  other  resource 
requirements  essential  to  the  Operations  and 
Maintenance  (Os  M  )  of  a  weapon  system  have  been 
determined  using  the  traditional  "flying  hours’"  and 
"sortie  rate"  measures.  The  deficiencies  of  these 
traditional  measures  arc  well  known  and  such 
measures  frequently  are  found  to  he  totallv 
irrelevant.  For  example  maintenance  on  a  gun 
subsystem  is  generated  by  factors  like  the  number  of 
rounds  fired  and  is  not  affected  by  the  number  of 
flying  hours  or  sorties.  These  traditional  measures 
are  also  insensitive  to  variations  in  operations  and 
environmental  conditions.  The  present  difficulties 
then  lie  in  the  fai  l  that  the  currently  used  metrics  do 
not  consider  the  inherent  differen  cs  between  the 
individual  subsystems  of  a  weapon  system  and  are 
totally  insensitive  to  operational  and  environmental 
conditions. 

The  objective  then  is  to  determine  the  hardware, 
operations  and  environmental  parameters  which  are 
necessary  and  sufficient  to  identify  the  drivers  of 
maintenance  demands  for  a  weapon  system,  and  to 
develop  more  accurate  metrics  and  weightings  to  lie 
incorporated  into  the  Air  Force  method  (Logistics 
Touipositc  Model)  ol  determining  manpower  and 
other  resource  requirements  for  operational  and 
developing  weapon  systems. 

Im  pm  it l  tilizotio  n  :  The  maintenance  metrics  that 
are  developed  will  provide  a  method  for  measuring 
and  predicting  the  functional  relationship  between 
the  maintenance  demands  and  the  hardware, 
operations,  and  environment  of  a  developing  aircraft 
system.  The  metrics  when  used  within  LOOM  will 
provide  the  Air  Force  with  a  powerful  tool  to  aid 
trade-off  decisions  from  conception  through  the 
operational  life  of  any  Air  Force  aircraft  system. 


Title:  Development  of  I’oliey  Analysis  Model  for  the 
Air  F’orre  Izigislics  System 

Description:  T  he  policy  analv-i- model  is  designed 
for  use  in  policy  development  and  in  resource 
loalrol.  It  is  designed  to  enhance  the  understanding 
of  the  overall  impact  ol  the  policies  established  bv 
senior  management  upon  the  verv  complex  logistics 
sy  stem  Simultaneously .  it  provides  a  means  to 
evaluate  the  effects  ol  these  policies.  I  lie  first  phase 
of  this  effort  ha-  been  completed  and  consisted  ol  the 
development  of  a  conceptual  model  of  the  \ir  Force 
Logistics  System  bv  means  ol  extensive  interviews 
conducted  through  the  logistics  community.  The 
results  of  these  interviews  allows  the  researchers  to 
define  and  gain  comprehensive  understanding  of  the 
system,  its  organization,  functions,  and  interactions 
among  its  various  principal  lomponents.  T  he  \  i r 
Force  Logistics  System  is  a  classic  information 
feedback  structure.  T  he  approach  ol  the  on-going 
research  is  to  decompose  this  structure  in  a  series  ol 
steps  based  on  system  conceptualization,  analysis, 
and  measurements. 

Imp  net/ 1  tilizotion:  Flic  conceptual  model 

developed  through  this  exploratory  research  will  he 
the  basis  of  policy  dev  elopinetll  and  resource  control 
bv  senior  Air  Force  managers  within  the  logistics 
>  out m  unitv  . 


Title :  K  valuation  of  Resource  Trade-Off  and 
Allocation  Methodologies 

Description:  Efficiency  and  appropriation  of 

mathematical  and  statistical  methodologies 
applicable  in  decision-making  processes  are  being 
compared.  In  particular,  single- and  multi-attribute 
utility  and  value  function  algorithms,  judgment 
analysis,  and  policy -specifying  are  being  examined 
for  their  relative  usefulness  and  applicability  for 


decision-making  processes  when  the  possible 
alternatives  are  uneerlain  and  for  which  the  goals 
and  objectives  of  (lie  derision  environment  are  in 
eonfliel.  Resources  in  (he  resea  re  h  and  dev  clopinenl 
area  and  the  personnel  assignment  area  are  being 
used  as  the  derision  environment  in  comparing  the 
v  ariotts  methodologies. 

Impact/l  tilization  The  results  will  provide  Air 
Force  personnel  managers  with  better  tools  to  assist 
tn  making  derisions  regarding  personnel  selection 
and  resource  utilization 


Title:  Functional  literary  Task  Inventory 

Description:  Although  the  Air  Force  has  been 

much  concerned  with  the  problem  of  making  sure 
that  the  literacy  demands  of  a  career  field  are  not 
beyond  the  capacity  of  personnel  assigned  to  that 
field,  no  study  has  been  performed  to  determine 
precisely  what  these  demands  are  for  different  jobs, 
the  consequences  of  a  mismatch  between  job 
reading  demands  and  personnel  reading  ability  have 
also  not  been  determined.  The  present  effort 
represents  the  first  step  in  the  attempt  to  obtain 
answers  to  these  questions.  By  means  of  successive 
i  v<  It  s  of  trvoul  data  analysis,  and  survey  instrument 
refinement  a  methodology  for  the  task  analysis  of 
job-related  literacy  tasks  is  being  developed. 

Im  pm  t  l  tilization.  The  eventual  produ  I  of  this 
effort  will  lie  a  lield-tested  survey  instrument  for  use 
within  the  framework  of  the  Air  Force  occupational 
siirv  ev  sv  stem  .  I  he  administration  of  this  survey  will 
allow  the  characterization  and  clustering  of  Air 
Force  jobs  in  terms  of  their  literacy  task  demands. 
This  information  should  ultimately  lead  to  more  job- 
specific,  job-relev  ant  reading  improvement  training, 
more  precise  and  cost-effective  personnel 
assignment,  and  better  design  of  Air  Force 
documents. 

Title:  Histiurical  llata  Base  of  Enlisted  Personnel  by 
Cohort  Year  (.roup 

Description :  The  primary  objective  of  the  Cohort 
Itata  Base  is  to  support  loss/reenlistment/extension 
analyses  requirments/trends  bv  fiscal  year  of 
accession.  This  data  base  has  been  developed 
covering  accessions  and  associated  loss/reenlistment/ 
extension  transactions  for  the  time  period  FY70- 
FY  78.  Statistical  tables  which  have  been  prepared 
using  this  data  base  reflect  (a)  percentage  of  total  lost 
(within  each  type  of  loss  category),  (b)  percentage  of 
loss  from  accessed  population  at  the  beginning  of  a 


year  to  cover  a  10-vear  period,  (c)  cumulative 
percentage  of  ioss.  (d)  percentage  of  those  lost  in 
Basil  Military  Training  (BMT)  by  type  of  loss 
category,  (e)  percentage  of  those  lost  subsequent  to 
It  M  T  hv  tv  pe  of  loss  category.  ( f)  total  percentage  of 
extending  population,  (g)  percentage  of  beginning 
population  who  have  extended  and  are  on  extension, 
(h)  percentage  reenlisting,  (i)  percentage  reenlisting 
with/without  bonus,  (j)  percentage  reenlisting  with 
less/w  it h  more  than  *10  days  to  Expiration  of  Term  of 
Service,  and  (k)  percentage  of  losses  eligible/not 
eligible  to  reenlist.  Statistical  summary  tables  to 
prov  ide  quirk  reference  to  the  number  of  indiv  iduals 
accessed  in  each  fiscal  year  also  show  the  (a)  number 
lost,  (b)  loss  rate,  (e)  retention  rate,  (d)  continuation 
rate,  (e)  number  reenlisted,  and  (f)  reenlistment 
rate.  These  counts  and  percentages  are  reported  for 
each  of  the  10  fiscal  years  covered  by  the  report. 

Im  pact/I  tilization:  These  reports  will  be  used  to 
(a)  track  enlisted  retention  by  cohort  year  groups  (b) 
relate  enlisted  rentention/reenlistment/losses  to 
personnel  program  objectives,  and  (c)  analyze  the 
retention/reenli.stment/losses  of  cohort  year  groups 
by  various  demographic  attributes,  such  as.  sex.  race, 
academic  education  level.  Armed  Forces 
Qualification  Test  group  category,  term  of 
enlistment,  age  at  accession,  number  of  dependents, 
and  marital  status.  These  reports  will  be  used  by 
Personnel  Systems  managers  at  HQ  l  SAF.  the 
Military  Personnel  System,  and  the  Office  of  the 
Secretary  of  Defense. 


Title:  Integrated  Simulation  Evaluation  Model 

Description:  Tile  Integrated  Simulation 

Evaluation  Model  (ISEM)  is  an  AFHRI.  effort  to 
develop  a  total  system  simulation  model  of  the  Air 
Force  manpower  and  personnel  system,  including 
active  dutv  and  reserve  military  forces  and  civilian 
employees.  ISEM  departs  from  most  other 
manpower  personnel  modeling  efforts  in  its 
emphasis  on  the  Air  Force  manpower  and  personnel 
system  as  a  single,  unified,  integrated  system  which 
procures  and  translates  human  assets  into  mission 
capabilities.  The  total  system  orientation  constitutes 
the  basis  for  development  of  ISEM  as  a  large-scale 
simulation  model  which  integrates  subsystems  arross 
functional  specialties  and  evaluates  performance  of 
total  system  effectiveness  and  efficiency. 

Impact/ll  tilization:  ISEM  will  be  used  to  provide 
decision-makers  with  information  of  a 
fundamentally  different  type.  This  information  is 
different  in  that  it  systematically  incorporates  the 
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total  s  y  stout  perspective  into  high-level  policy 
analysis.  VI  ith  today's  policy  analysis  tools, 
understanding  the  total  system  impact  of  policy 
options  is  very  difficult.  ISKM  would  make  this 
important  requirement  much  more  attainable  !>v 
providing  a  generalized  capability  for  analyzing  how 
policy  interacts  with  all  the  elements  of  the  system 
(manpower,  personnel,  and  training)  to  affect  (a) 
mission  capabilities.  (It)  costs,  and  (c)  the  efficiency 


with  which  the  system  operates.  ISKM  will  provide 
the  decision-maker  with  improved  inlormalion  fair 
understanding  the  total  system  impact  ol  policy 
options.  This  will  provide  the  senior  decision-maker 
with  a  substantially  improved  basis  for  resolving 
many  important  high-level  policy  issues  within  the 
Air  I’orce  manpower  and  personnel  system  and  with 
an  improved  rationale  for  justify  ing  policy. 


TRAINING  DK VICKS  AND  SEVll  LATION  TECHNOLOGY 


Title:  Advanced  Simulator  for  Pilot  Training  (ASPT)  moving  models  to  he  shared  among  the  two  ASP  I 
Alternate  Display  modular  cockpit  displays. 


/Je.si  ri/ition :  The  cathode  rav  tubes  (CRTs)  used 
for  the  Advanced  Simulator  for  Pilot  Training 
(  AS!’ T)  arc  rapidly  approaching  their  projected  life 
span.  Sixteen  replacement  TRTs  will  be  required 
within  the  next  2t  months:  necessitating  a  combined 
refurbishment  and  new  CRT  production  rate  which 
exceeds  past  performance  of  the  CR  T  vendor.  An 


by  replacing  one  of  the  present  CR  T  assent  lilies  w  ith 
a  IIMIO-line  light  valve  projector,  lens,  and  rear 
screen  assembly. 


Impact:  The  additional  visual  moving  model 

capacity  will  lie  used  to  visually  simulate  moving 
ground  targets,  friendly  and  enemy  aircraft,  surface- 
to-air  missiles,  aircraft  rocket  fire,  and  other  moving 
features  indigenous  to  hostile  environments.  This 
capability  enables  behavioral  research  to  assess 
moving  model  requirements  for  tactical  simulation, 
development  of  simulator  training  syllabuses,  and 
generation  of  air  combat  tactics. 


Impact:  One  channel  of  the  ASI’T  display  will  In- 
replaced  with  a  light  valve  projector  in  order  to 
assess  its  performance,  maintainability .  and 
reliability.  If  it  is  successful,  the  light  valve  projector 
will  provide  the  .  ASPT  display  system  with  one 
alternate  source  which  should  be  more  readily 
available  and  reliable  on  a  competitive  basis.  I  bis 
would  also  provide  additional  reliability  j^ftl 
maintenance  data  for  similar  projects. 


Title  :  Advanced  Simulator  for  PilyPTraiiiing  Multiple 
Moving  Model  engineering  Devc lopme lit 

Ih'st  riptinn:  In  its  original  configuration,  the 

Advanced  Simulator  for  Pilot  Training  (ASPT) 
roinputer-imagc-gone rated  visual  system  provided 
one  moving  model  for  each  ol  the  two  cockpit 
displays,  lor  purposes  of  undergraduate  pilot 
training  research,  this  was  adequate.  However,  with 
the  expansion  of  research  into  the  tactical  research 
arena,  additional  moving  models  are  required  to 
v  isually  simulate  dy  uamie  hostile  environments.  The 
purpose  of  this  modification  is  to  provide  up  to  seven 


Title:  Assessment  of  Avionics  Management  in  T-I.’i 
Dissimilar  Air  Combat  Training 

Dear  r  i/> lion :  T  -  I  T>  pilot  performances  in  the  in  tilt i- 
bogie  air  combat  environment  have  indicated 
^/adequate  acquisition  and  retention  ol  skills 
necessary  to  achieve  satisfactory  levels  of  combat 
readiness.  The  initial  portion  of  an  aerial 
engagement  ( ■ beyond  visual  range)  has  been 
identified  as  a  problem  area.  This  portion  of  the 
engagement  involves  the  use  of  av  ionics  in  acquiring, 
identifying,  and  prioritizing  the  targets.  Currently, 
training  for  this  portion  of  the  engagement  is 
minimal.  The  training  problems  are  compounded  by 
the  lack  of  performance  measurement  lor  use  in 
evaluation  and  instruction.  Simulator  software  has 
been  developed  for  training  the  bevond-v isiial-range 
segments  of  dissimilar  aerial  combat.  The  simulator 
scenarios  provide  realistic  radar  target  maneuvering. 
The  training  will  he  used  in  conjunction  with  a 
performance  measurement  system  developed  fur 
application  in  both  simulator  and  aircraft 
engagements.  The  simulator  training  and 
performance  measurement  will  be  validated  during 
aggressor  squadron  engagements. 


r.» 


I  ill  purl:  The  results  of  this  effort  an  he  extended  to 
other  weapons  systems  and  applied  during  formal 
and  continuation  training  to  increase  proficiency  in 
dissimilar  aerial  combat. 


Title:  A- 10  Training  and  Research  Kngine e ring 
Development  (AS I’Tj 

Description-.  Phase  I  of  the  Advanced  Simulator 
for  Pilot  Training  (ASPT)  \-ltt  Project  consisted  of 
modifying  cockpit  "A"  of  the  ASPT  from  a  T -3 7  to 
an  \-lt)  configuration.  The  modification  provided 
conversion  and  tactical  weapons  dcliv  erv  training  for 
the  Tactical  Air  ('.ointnand  (TA<T  and  the  ability  for 
\FHRT  to  conduct  training  research.  Phase  II  will 
prot  ide  advanced  conversion,  manual  rev  ersion.  and 
hostile  tactics  research  and  training.  The  Phase  II 
cockpit  of  A -I  (I  is  an  in-house,  modular  design  and  is 
capable  of  being  used  for  research  studies  not  directly 
connected  with  A  -10  aircraft  nor  T  AP,  training. 
Research  performed  this  year  included  motion/force 
cueing  studies  in  the  ASPT  using  A-10. student  pilot 
subjects  in  conversion  and  air-lo-surfaee  training 
Proposed  activities  include  studies  of  the  Inertial 
Navigation  System  (INS)  heads-up  display 
symbologies  for  the  A-10  aircraft,  lev el-nf-detail  of 
computer  image  generation  (Pit!)  inquired  for  a  KP- 
1  35  tanker  model  to  accomplish  air  refueling 
training,  and  tactics  used  for  low-level  flight  in  a  high 
threat  environment.  Continuing  engineering 
research  and  development  includes  the  completion 
of  the  modular  A-10  cockpit  to  flv  in  the  Manual 
Reversion  Flight  Control  System  mode  and 
expanded  simulated  hostile  environments. 

Impact.  The  “A"  cockpit  of  the  ASPT.  presently  in 
a  modular  A-10  cockpit  configuration,  will  he  used 
for  TAC  A-10  training  until  the  delivery  of  A-10 
simulators  to  TAC.  It  will  also  he  used  for  research 
on  high-threat  environment  tactics.  Ry  providing  a 
research  tool  for  simulated  hostile  environment 
studies  visual  display  requirements,  force  cueing,  and 
advanced  instructional  methods,  ASPT  A-10 
simulation  provides  the  Air  Force  with  a  valuable 
flying  training  research  tool.  This  simulation  also 
provides  TAC  with  a  unique  opportunity  to  acquire 
valuable  simulation  training  during  research  studies. 


Title:  Design  and  Delivery  of  Flat-Panel  6883 
Simulator  lor  Comparison  with  Three-Dimensional 
Maintenance  Simulator 

Description:  The  objective  is  to  develop  a  flat- 
panel  simulation  of  the  6883  Converter/Flight 
Controls  Test  Station  associated  with  Intermediate- 


l.evel  maintenance  of  the  l  -l  I  1  aircraft.  The 
simulator  will  subsequently  he  used  in  studies  of  the 
impact  of  psychological  fidelity  inherent  in  real 
equipment,  three-dimensional  simulators  flat-panel 
simulators  and  graphics  simulations  on  technical 
training  and  subsequent  job  performance.  The 
civilian  contractor  will  design  a  flat-panel  simulator 
providing  comparable  training  capability  to  the 
three-dimensional  simulator  previously  developed. 
To  maximize  comparisons  between  the  two 
simulators,  parameters  will  he  contrasted  insofar  as 
practical.  Initial  areas  where  contrasts  appear  to  he 
feasible  are  (a)  physical  fidelity,  (h)  minicomputer 
vs.  in  i  cm  processor  control.  ( c )  FORTRAN 
programming  vs.  an  ATI.AS-like  language,  (d) 
degree  of  integration  w  ith  theory  portions  of  course, 
(e)  environmental  requirements,  (f)  indigenous  vs. 
adjunctive  knowledge  of  results,  (g)  relative 
emphasis  on  procedures  and  system  logic,  (h)  degree 
of  performance  monitoring,  and  (i)  efficacy  of  stand¬ 
alone  part-task  trainers  associated  with  the  simulator. 

Impaclll  tilization:  This  research  will  result  in  a 
flat -panel  simulator  and  the  associated 
documentation  required  update  and  modification  of 
the  simulator.  The  simulator  will  be  utilized  in 
subsequent  investigations  of  the  impact  of  physical 
fidelity  on  training  in  an  effort  to  ascertain  degree  of 
realism  required  for  cost-effective  training.  Results 
hear  promise  of  having  utility  in  the  development  of 
future  trainer  requirements  and  specifications.  These 
results  will  he  meaningful  both  in  terms  of 
developing  training  programs  for  new  weapon 
systems  such  as  the  M  \  missile,  and  also  for 
improving  training  on  existing  systems.  One  area  of 
particular  interest  is  the  impact  of  lowered  fidelity 
on  the  time  required  to  develop  and  implement  new 
training  programs. 


Title  :  F-l  6  Resea  nr  h  Pnigram 

Description:  The  introduction  of  the  multi-role  F- 
16  aircraft  into  the  Air  Force  inventory  will  greatly 
increase  pilot  training  requirements.  Teaming  to 
master  air-to-air  or  air-to-surface  combat  skills  is  a 
difficult  and  demanding  task,  hut  when  piloting  skills 
are  necessary  in  both,  the  additional  training  load  is 
significant.  Furthermore,  the  F-16  incorporates 
advanced  technologies  (e.g.,  fly-by-wire  control,  a 
high  *‘g”  and  high  visibility  cockpit,  a  digital 
computer  system  for  heads-up  display  and  avionics, 
etr.)  that  will  make  initial  and  transition  combat 
crew  training  a  difficult  job.  F.ven  the  experienced 
pilot  will  have  little  familiarity  with  the  instruments 
and  controls  used  in  the  F’-I6.  The  F-16  weapons 
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-y  sic  hi  with  it'  man  v  unique  design  bat  m  c-  ami  il  nal 
<oliili.il  roll-  raises  a  (ili-llmra  ol  imul  training 
research  issues.  I'ln-ri-  is  .i  general  consensus  tlial  the 
two  major  psychological  component-  ol  piloting 
ability  an-  cognitive  ami  |»-ri  i-pliial-inoior  skills.  In 
tin-  F-lb  weapons  system.  training  skills,  in  rarli  ol 
these  two  components  takes  nil  nrw  ilimriision-.  I  he 
selection  of  weapons,  tin-  inli-rpri-lalion  of  lire 
control  displays,  and  tin-  larliral  employment  of  the 
airrrall  all  involvr  cognitive  element'  in  behavior 
Vt  itli  tin-  flv-bv-wire  systrni.  tin-  rontrol  of  tin-  I-  - 1  f > 
also  heroines  a  critical  factor  in  training.  How 
quickly  ran  tin-  novice  pilot  aiiapt  to  this  sy  tern  .' 
Vi  hat  relearning  problems  fare  tin-  transitioning; 
pilot."'  F inallv .  does  the  high  visibility  cockpit.  with 
its  dearth  of  aireraft-refereneed  em-s.  pose  diflirulty 
for  the  pilot  in  elose-to-the-earth  maneuvers'  An  F- 
l()  training;  research  program  using  the  Advanced 
Simulator  for  Pilot  Training  (VSP1I  has  been 
developed  as  a  result  of  a  significant  delay  between 
delivery  of  the  F-lb  aircraft  and  subsequent 
availability  of  its  flight  simulator.  The  f-lb 
Operational  Plight  Trainer  w  ill  not  be  available  until 
Summer  I ‘>K0.  and  the  Full  Mission  Simulator 
(FMS)  will  probably  not  be  in  service  until  I'W  for 
later.  The  AS PT/F-I (>  training  research  program  will 
enable  pilots  entering  F-lh  training  to  receive 
simulator  training  and  will  also  give  psychologists 
the  opportunity  to  research  advanced  fighter 
simulation  systems.  The  two  core  components,  i.e.. 
cognition  and  perceptual-motor  control,  reappear 
throughout  the  F-lh  training  research  spectrum 
They  are  driving  (actor-  in  simulator  design,  training 
media  mi\.  syllabus  development,  and  performance 
measurement.  I  he  advanced  concepts  employed  in 
the  F-lh  design  must  hi-  matched  bv  equally 
advanced  concepts  in  the  F-lb  training  domain 
Since  till-  potential  of  til*1  f-lb  i-  -o  great,  every 
effort  m  list  be  made  to  evploit  it-  capabilities 
through  optimum  training. 

Since  the  radical  Air  bommanil  training 
requirement  materialized  in  lb?1).  a  gap  has  evisted 
between  training  requirements  and  training 
capability .  The  Asl’T  research  program  will  satisfy  a 
real  operational  need  in  addition  to  building  an 
advanced  aircraft  Research  and  Development  data 
base.  This  data  base  will  be  used  for  determining  F- 
I  b  f  M  S  design  configuration,  and  it  will  also  prov  ide 
a  cornerstone  for  training  research  dealing  with 
advanced  technology  aircraft. 


Tide  :  F-lb  Simulation  Fnginee ring  Development  oil 
tile  Advanced  Simulator  for  Pilot  Training 

l)r r  i/>  I  ia  n  :  On  2~>  September  IbT'l.  AIHHI. 
.icbu-y  cil  a  new  milestone  as  the  first  grott|i  of 
subjects  for  the  F-lb  training/resi-arcb.  completed 
lln-ir  training  in  the  Advanced  Simulator  lor  Pilot 
framing  (  ASPT).  This  group  consisted  ol  future 
North  Atlantic  Treaty  Organization  (NAIO)  F-lb 
instructor  pilots.  This  activity  followed  a  year-long, 
intensive,  in-house  engineering  effort  which  resulted 
in  major  changes  to  the  Advanced  Simulator  lor 
Film  Training  I  ASPT)  system.  Included  wa-  the 
integration  of  a  distributive  processor  system, 
replacing  tin-  single  computational  system  used  ,o 
simulate  the  I -.17.  The  "If  side  T-IT  cockpit  was 
replaced  with  a  modular  F-lb  eorkpit  In  allow  tor 
initial  air-to-snrfaee  taetieal  research.  A  major 
software  effort  was  required  to  duplicate 
performance  and  handling  qualities  of  the  I  -lb. 
Special  efforts  were  needed  to  accommodate  the 
nctitrallv  stable  aircraft  and  to  duplii  ate  the  aircrali 
analog  flight  control  computer  Fugitu-  simulation 
was  also  cli.illciiging  as  the  F-MNI  i-  a  very 
sophist ieated  engine  using  a  <  om  lunation  ol 
mi  elianii  al  and  clectrie.il  eoutrol-  *  > u«-  ol  tin 
outstanding  in-lnni'<-  engineering  aclm-y  i-mi-m  -  wa¬ 
in  tin-  simulation  ol  the  I  -lb  -tali  -ot-llu  -art  a\  lonn  - 
network  I  sing  an  a<  tlial  aircrali  In- id  -up  ■( i -|> hi y 
(III  I  > ) .  stores  control  panel  l's(  P  lire  control 
navigation  panel  (ft  N  P ) .  side  arm  oniioller.  and 
ihrmtle  grip-,  engineering  personnel  .rtiiivrd  a 
v  irlual  duple  atiou  ol  the  sophistn  ah  I  nr  n  -nrl.n  > 
delivery  modes  <  <  f  the  l  ln  I  hi-  nn  nlv  ul 
consider. i fill-  software  d«-y  i  lopiu cn t  to  duple  an-  the 
aircraft  lire  control  <  ntnpiiti  r  In  addition,  -pei  ial 
computer  interlaces  were  devi  loped  lo  drive  the 
St.P  and  to  allow  the  ASP  I  geiieial  purpose 
computer  to  transmit  data  over  a  simulated  aircrali 
multiplex  hu-  to  tin-  III  It  and  It  \P  In  support 
research  reqi  irements.  completely  new  pi-rliiruiani  c 
mi-asurenie  .(  schemes  and  data  record  -i  hemes  were 
ilevelo'"  !.  As  research  continues,  these  will  he 
relined  to  provide  the  must  com  prchcnsiv  e. 
quantitative  data  oil  weapons  delivery.  I  lie  revised 
ASP T  system  allows  for  the  heginning  of  a  new  era  in 
simulation  research. 

/ m  /me I :  The  ASP  I  F-lb  w  ill  In-  used  hy  the 
Tactical  Air  l.iiiniiuiiiil  anil  bv  the  Air  Force  Systems 
( ami  hi  and  to  conduct  valuable  research  oil  the  use  of 


wide-ficld-of-view  (WI'OV)  simulator-  for  training 
tactical  I  a  -  k  - .  This  sim  nlal  ion  shoitlii  further 
demonstrate  utility  of  Vi  FO\  visual  systems  for 
training  tactical  maneuvers  in  conventional  and 
hostile  environments  and  provide  a  research  device 
for  evaluation  of  simulated  hostile  environments, 
force  cueing  schemes,  and  advanced  instrumental 
methods.  I  \C  will  also  have  an  interim  simulator 
i  aoahililv  for  l  -lti  pilot  training. 


litle :  Implementation  of  a  Helmet  Mount)  (I  Sensor'' 
lieimet  Mounted  Ifkiilav  on  die  Advanced  Simulator 
lor  Pilot  I  minim: 

/  >r  sc  r  ip  t  in  n  :  AIHRI  is  in  the  process  of 
integrating  state-ol-lhe-art  equipment  with  the 
Advanced  Simulator  for  Pilot  Training  (  \SPT)  as  a 
follow-on  to  the  engineering  feasibility 
demonstration  of  the  helmet-mounted  sensing  and 
displav  equipment  borrowed  from  the  Aerospace 
Medical  Research  l.ahoraory  The  new  helmet- 
mounted  sensor  (II  MS)  utilizes  an  electromagnetic 
field  detector  rather  than  an  infrared  detector  and 
provides  \.  V.  /  (roll,  pilch,  and  vaw)  data.  This 
information  is  supplied  to  a  greater  degree  of 
accuracy  for  a  wider  range  of  helmet  motion, 
compared  to  the  previous  equipment.  The  II  MS/ 
h  e  1  m  e  t  -in  o  ti  n  t  ed  display  (HMD)  will  be 
implemented  in  both  ASPT  cockpits.  The  HMD 
consist  of  a  small  cathode  ray  tube  (CRT)  mounted 
on  the  side  of  the  pilot's  helrnent.  projecting  a  display 
on  a  combining  glass  in  front  of  the  pilot's  eye.  This 
system  presents  either  a  high  resolution  range  (less 
than  I  to  f  are  minute)  monocular  (right  or  left  eye) 
central  vision  area  (I  to  VO  degree  field  of  view 
(FOV))  display,  or  two  units  may  be  combined  to 
provide  binocular  coverage  in  conjunction  with  the 
ASPT  full  FOV  display.  The  HMD  collimated  image 
is  at  the  same  focal  distance  as  the  background  ASPT 
wraparound  display  and  will  be  optically  combined 
w  ith  the  background  which  is  observable  with  both 
eyes.  The  system  also  allows  unconstrained  pilot 
movement  within  the  cockpit  and  will  provide  a 
correct  image  perspective  with  occlusion  by  the 
pilot's  aircraft. 

• 

Impart:  Installation  of  the  HMS  equipment  will 
provide  the  capability  to  utilize  the  ASPT  in  pilot 
workload,  head-in  cockpit,  head  vs.  aircraft  attitude, 
and  visual  FOV  studies.  The  addition  of  HMDs  in 
both  ASPT  cockpits  will  vastly  expand  the  research 
potential  to  include  key  issues  in  visual  flight 
simulation.  Studies  may  he  conducted  to  determine 
resolution,  scene  detail,  and  FOV  requirements  for 


various  fixing  tasks.  HMDs  may  lie  evaluated  for 
their  Iraining  potential  in  air  combat  maneuvering, 
air  combat  tactics,  stand-olf  weapon-  system-,  and 
associated  tactics.  Fvaluation  may  also  he  performed 
on  flv-bv -sensor  system  display.  Maverick  missile 
helmet  displays,  and  helmet  display  of  aircraft  data. 
With  the  F-lti  and  A -10  cockpits,  studies  could  also 
he  performed  to  develop  F-lt)  and  A -10  tactics 
training  scenarios,  i'hc  findings  from  studies  using 
the-  equipment  should  be  very  useful  in  designing 
specifications  for  future  flight  simulators  having  the 
potential  of  resulting  in  considerable  dollar  sav  ings, 
reduced  training  time,  enhanced  operational 
readiness,  and  increased  capabilities  and  training 
effectiveness 


Tide  :  Ope  rational  Test  and  Fvaluation  Handbook  for 
Aircrew  Iraining  Devices 

Description:  The  Air  Force  plans  extensive 

simulator  procurements  in  order  to  maintain 
operational  readiness  and  reduce  training  costs. 
These  simulators  will  be  employed  across  the  entire 
flight  training  spectrum,  beginning  with 
undergraduate  pilot  training,  continuing  through 
combat  crew  training,  and  culminating  in  the 
maintenance  of  proficiency  in  aircrew  skills.  The 
critical  requirement  is  that  these  simulators  provide 
a  training  medium  that  enhances  aircrew  quality 
while  using  fewer  resources  than  would  be  consumed 
by  the  aircraft.  Since  significant  Department  of 
Defense  investments  depend  on  the  capabilities  of 
these  simulators,  their  training  effectiveness  must  be 
throughly  and  accurately  evaluated.  Although  the 
Air  Force  plans  to  conduct  a  series  of  tests  and 
evaluations  on  these  devices,  the  methodologies  and 
techniques  by  which  these  are  to  be  accomplished 
have  not  been  determined.  W  hat  can  be  stated  with 
certainty  is  that  a  multidisciplinary  approach  will  be 
required.  At  a  minimum,  thorough  tests  and 
evaluations  will  include  considerations  of  training 
capabilities  and  transfer,  media  utilization,  human 
engineering,  device  reliability  and  maintainability, 
and  life-cycle  costs.  As  a  consequence,  knowledge 
from  the  f i e I d s  of  psychology,  education, 
engineering,  and  economics  must  be  combined  to 
provide  a  cohesive  approach.  Consequently,  a 
handbook  is  required  that  will 

I.  Determine  appropriate  methodologies  that  can  be 
utilized  a-  standards  for  assessing  simulator  training 
effectiveness.  Tile  major  elements  of  this  effort  will 
include: 


a.  Application  of  alternate  definitions  of  trainin'; 
effectiveness  suitable  for  various  systems. 

l>.  Selection  of  measures  and  techniques  that  will 
validly  and  relialdv  evaluate  levels  of  individual  task 
performance  for  both  student  and  instructor/ 
operator  personnel.  This  activity  will  consider  such 
items  as  appropriate  statistical  analyses,  sample  sizes, 
sample  representativeness,  and  training  criteria 
selection. 

c.  Investigation  of  -t udeti t/i nst r in  to r/opc ralor/ 
training  manager  attitudes  and  their  impact  on 
simulator  acceptance,  utilization,  and  confidence  in 
the  training  program. 

d.  I  n v  estigation  of  the  relationship  between  system 
availability  and  reliability  anti  the  capability  to 
maintain  the  intended  training  progam. 

2.  Determine  appropriate  techniques  to  evaluate 
system  control  features  such  as  the  instructor/ 
operator  console:  adaptive  training  provisions: 
system  operability;  anti  special  system  training 
capabilities,  lor  example,  freeze,  reset,  automated 
playback  anti  prerecorded  demonstrations. 

A  Determine  the  appropriate  composition  of  the 
Operational  l  est  and  F, valuation  Team  in  terms  of 
disciplinary  skills  anti  experience. 

f.  Identify  the  resources  necessary  to  conduct 
operational  tests  and  evaluations  in  terms  of 
personnel,  hardware  and  software  considerations. 

Impart:  The  research  results  w  ill  (a)  provide  \  i r 
f  orce  leadership  with  direction  in  making  -ound 
decisions  in  allocating  huge  expenditures  on  aircrew 
simulators  and  (b)  itrov ide  the  operational  Air  force 
units  proper  methodology  in  the  planning  and 
•onduct  of  aircrew  simulator  test  and  evaluation 
urograms  for  a  variety  of  systems 


fide  :  Psychological  Aspects  of  Sc  nsor  Simula  lion 

Description:  I  he  objective  ol  this  program  is  to 
determine  the  feature.-  ol  operational  sensor  display  - 
that  must  he  emulated  with  coin  puter-geueraled 
imagery  M.(.l)  lor  effective  training  of  aircrews 
Systems  such  as  the  forward  looking  Infrared 
If  I. IK  l  and  low  light  l.evel  Television  (III  ,T\) 
-eusors  increase  the  terrain  avoidance  capability  of 
the  lf-."ij  during  weather  pent  rations  anil  night 
flving.  I  hc-r  -cn-or-.  however,  result  in  formidable 
problem-  for  the  development  of  effective  training 
devices,  first,  the  quality  of  the  image  presented  to 
the  operator  by  the  FI, IK  sensor  is  dependent  on 
such  factors  as  the  thermal  emissivity  of  ground 
objects  anil  their  surround,  sun  angle,  meteorological 
conditions,  and  season  of  the  year.  Second,  the  flight 
profiles  that  must  he  simulated  for  training  require 
that  large  gaining  areas  he  represented  for  long  range 
missions.  These  problems  cannot  he  solved  with 


terrain  model  boards.  I  filler  related  program*, 
efforts  arc  underway  to  develop  the  technology  ol 
Using  computer-  to  emulate  I  fill  and  i.I.I.  I  l 
image-  The  co-t  ol  -ueh  com piiter-ha-'d  system*, 
however,  is  influenced  hv  the  degree  ol  detail  in  III** 
,-v  Nilo  tic  image.  \ ccordingl v .  the  purpose  of  ilu- 
prograin  is  to  determine  how  much  fidelity  and 
realism  are  requited  to  produce  adequate  training  of 
.elisor  operator-.  I  lie  objectives  are  being  pursued 
from  several  research  avenues.  I  ir-I.  analytical  and 
empirical  investigations  are  being  carried  out  to 
determine  what  features  ol  the  -en-oi  images 
influ  cine  performance  during  terrain  avoidance 
living,  navigation  update,  obstacle  detection,  and 
dam  age  asse-sin  en  t /-I  ri  ke  and  how  these  feature- can 
lie  emulated  with  t.t,l.  I  Itese  studies  include 
procedures  dial  .  (impure  real-world  imagery 
obtained  from  Ho-  sorties  with  tile  emulation  of  the 
-aim-  images.  Second,  terrain  and  (  littoral  feature*, 
meteorological  factor-,  and  other  environmental 
variables  are  being  studied  for  their  potential  effect 
oi  the  flving.  ta.-ks  mentioned  above  Various 
methods  for  emulating  the  physical  properties  of  the 
scenes  w  ith  t  :t,l  are  Investiated.  The  resulting  images 
are  then  assessed  to  determine  the  level  of  fidelity 
required  in  the  scene  to  accomplish  effective 
training. 

Impart/I  tilizalion :  This  research  should  have  a 
significant  impact  on  current  and  future  work 
dealing  with  computer  generated  imagery  for  sensor 
simulation.  More  specifically .  11  will  identify  the 
amount  of  fidelity  needed  lor  adequate  training  of 
sensor  operators.  The  results  can  lie  used  hv 
organizations  such  as  the  Simulator  Systems 
Program  tMlicc  a.-  well  as  hv  other  agencies  and 
individuals  that  carry  out  research  and  development 
on  (A.  I  lor  training. 


Operator  Station  for  \ssrssmeiil  ol  t.oinputcr-ticnrrateil 
I  inagerv . 


fide:  Simulator  tor  Air-to-Air  (fiunbat—  Advanced 
Simulator  for  Pilot  Training  Interface 

Description:  \  low  cost,  low  priority 


(.2 


demonstration  project  is  being  implemented  to  show 
that  two  simulators  at  widely  separated  geographical 
locations  can  he  used  in  an  interactive  mode  for  air- 
to-air  combat,  aerial  refueling,  and  various  tactical 
scenarios.  The  devices  to  he  used  are  the  Simulator 
for  Air-to-Air  Combat  (S  A  AC)  and  the  Ad  vanned 
Simulator  for  Pilot  Training  (ASPT).  The  SAAC  is 
installed  at  I. uke  \FB.  approximately  30  miles  west 
of  Phoenix:  the  ASPT  is  installed  at  Williams  AFB. 
approximately  30  miles  east  of  Phoenix.  SAAC.  is 
comprised  of  two  F-l  cockpits  mounted  on 
synergistic  six  degrees-of-freedoni  motion  systems. 
Each  cockpit  is  enclosed  by  eight  cathode  rav  tubes 
(CRTs)  and  collimating  windows  displaying  the 
visual  scene  and  affording  the  pilot  a  nearly 
unlimited  field  of  view.  The  visual  display  is 
provided  by  an  electronic  sy  nthetic  terrain  generator 
and  a  camera  model  aircraft  image  generator.  Each 
pilot  is  furnished  a  representation  of  the 
maneuvering  of  the  adversary  aircraft.  G -seats  and  g- 
suits  provide  vibration  cues  to  supplement  those 
fro  III  Ih  e  motion  system.  The  gunfire  trajectories  and 
missile  trajectories  are  computed  so  that  the  scoring 
system  can  accurately  assess  hits  during  simulated 
engagements.  The  ASPT  is  capable  of  simulating  a 
variety  of  aircraft,  including  the  A-10.  F-16.  B-52. 
and  T-37.  Each  cockpit  in  the  ASPT  is  enclosed 
within  a  seven-channel  visual  display  subsystem.  The 
system  is  presently  configured  as  an  A-10  aircraft  on 
cockpit  "A"  and  as  an  F-16  aircraft  on  cockpit  "B." 
Various  incompatibilities  existing  between  the  two 
systems  had  to  be  overcome:  for  example,  the  SAAC 
operates  at  an  iteration  rate  of  20  times  a  second, 
whereas  the  ASPT  has  a  rate  of  30  times  a  second. 
The  most  inexpensive  manner  of  integrating  these 
two  romputer-controlled  systems  was  through 
dedicated  land  lines  leased  from  the  telephone 
company.  After  considerable  in-house  engineering 
effort,  the  system  was  made  acceptable.  The 
specifications  for  the  ASPT-SAAC  tie-in  were 
completed  1  March  1070,  and  the  first  engineering 
demonstration  was  conducted  14  October  1979. 

I  m  p  ac  l :  The  following  capabilities  were 
demonstrated,  (a)  Both  simulators  can  be  preset  to  a 
common  initialization  point  using  predetermined 
displacements,  (b)  The  pilot  in  the  SAAC  can 
observe  the  ASPT  pilot  maneuvering,  appearing  as  a 
M  1(7-21.  (c)  Simultaneously,  the  pilot  in  the  ASPT 
observes  the  SAAC  pilot  maneuvering,  also 
represented  by  a  MIG-21  moving  model,  (d)  The 
pilots  are  free  to  perform  any  required  change  in 
attitude  or  power  necessary  in  a  real-world  situation 
to  obtain  a  “kill.”  (e)  Each  system  independently 
determines  whether  its  pilot  has  been  successful  in 


causing  the  destruction  of  the  other  participant,  (f)  A 
confirming  message  from  the  winning  system 
computer  informs  the  losing  system  computer  of  the 
kill,  (g)  AT  this  point,  both  systems  freeze  in  the 
condition  existing  when  the  victim  was  terminated, 
(h)  This  system  has  demonstrated  that  it  is  feasible  to 
interface  modern  simulators  which  are  physically 
remote  from  each  other,  (i)  The  application  of  this 
principle  with  utilization  of  military  satellites  for 
data  relay  will  allow  an  entire  new  spectrum  of 
simulator  usage,  greatly  expanding  the  usefulness  of 
simulators  in  improving  the  skill  of  operational 
aircrews. 

Title:  Summative  Evaluation  of  Three-Dimensional 
and  Two-Dimensional  Simulators  for  Maintenance 
Training 

Description :  To  provide  competent  maintenance 
technicians  to  the  field,  expensive  actual  equipment 
is  customarily  employed  during  training.  However, 
actual  equipment  neither  possesses  the  capability  to 
induce  malfunctions  nor  tests  the  delayed 
consequences  of  malfunctions  upon  systems 
performance  for  training  purposes.  Less  expensive 
real-time  simulators  do  possess  the  capability  for 
practical  training,  incorporating  hands-on  practice  to 
increase  troubleshooting  skills  on  samples  of  field- 
related  maintenance  problems.  In  addition  to 
improved  skills  training,  properly  designed 
computer-based  training  simulators  also  have  the 
potential  to  release  more  expensive  actual  equipment 
to  the  field.  M  ajor  objectives  of  this  evaluation  are  to 
comparatively  assess  two  simultors  (three 
dimensional  (3D)  and  two  dimensional  (2D))  and 
actual  equipment  on  instructional  cost-benefit,  and 
additudinal  dimensions  within  an  operational  Air 
Training  Command  course. 

I m  pac  t/ U  tilizalio  n  :  Comparative  data  are 
currently  being  gathered  on  the  3D  simulator  and 
actual  equipment.  Although  preliminary  pilot  data 
indicate  no  significant  differences  in  achievement, 
this  is  largely  due  to  the  lack  of  adequate  training 
time  (2-1/2  days)  and  sensitive  measures  of  objective 
criterion  performance.  Efforts  are  underway  to 
develop  alternative  objective  measures  of 
performance  and  adequate  training  time  extension. 
Acquisition  data  cost  comparisons  reveal  the  3D 
simulator  is  60%  less  costly  than  the  actual 
equipment.  Hence,  if  simulators  were  found  to  be  at 
least  as  effective  as  actual  equipment,  then  simulators 
might  profitably  be  deployed  throughout  entire 
maintenance  training  courses. 
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Title :  Visual  Cue  Requirements  for  Terrain  flight 
Simulation 

Description:  The  lack  of  adequate  visual  scene 
detail  is  often  considered  to  be  a  limiting  factor  in  the 
use  of  computer-generated  imagery  for  terrain  flight. 
Terrain  flight  is  an  important  means  of  survival  in 
the  face  of  the  enemy  and  it  includes  low  level, 
contour  and  nap-of-the-earth  flight  at  successively 
closer  approaches  to  the  ground.  In  such  close 
proximity  to  the  ground,  a  great  deal  of  visual  detail 
is  available  to  pilots,  far  more  detail  than  it  is 
currently  feasible  to  simulate  with  computer-image 
generation  (CIO)  systems.  This  research  study  has 
developed  a  special  visual  environment  which  allows 
us  to  maximize  the  CIC  visual  cues  within  a  limited 
area.  During  the  study,  the  types  of  visual  cues 
available  to  the  pilots  will  be  varied  in  order  to 
identify,  by  pilot  performance  measurement,  the 
cues  that  are  most  important  for  terrain  flight 
simulation. 

Impact:  This  study  is  the  first  in  a  series  of  efforts  to 
develop  suitable  visual  rues  for  training  terrain 
flying.  This  critical  flight  skill  is  quite  hazardous  to 
perform  in  actual  aircraft,  thus  making  flight 
simulation  a  particularly  important  alternative  form 
of  flying  training.  This  particular  study  should  be 
especially  useful  because  it  seeks  to  implement 
simulation  training  using  C.IG  hardware  which  is 
already  operating.  Thus,  it  will  not  require  the 
development  of  new  hardware  techniques  before  it 
can  be  implemented  in  other  flight  simulators  using 
CIC  visual  displays. 


Nap-of-the-Karth  Simulation. 


Title:  6883  Maintenance  Training  Simulator 

Development  Utilizing  Imagery 

Techniques 

Description  :  The  purpose  of  this  exploratory  study 
is  to  evaluate  the  feasibility  and  training 
effectiveness  of  an  imagery  technique  known  as 
iinagetics.  The  technique  uses  visual  imagery  to 
enhance  learning.  The  imagetics  technique  is  a  novel 
method  for  determining  the  extent  or  effectiveness 
of  an  individual's  complete  menial  picture  of  some 
previously  memorized  graphical  matter.  To  use  the 
technique,  the  subject  graphically  reproduces 
portions  of  ihc  previously  memorized  matter,  e.g..  a 
geometric  figure,  but  the  reproduction  is  hidden 
from  view,  thereby  preventing  visual  feedback  in  the 
ordinary  sense.  Thus,  the  subject  is  forced  to  rely 
solely  on  a  mental  picture  when  reproducing  the 
object.  Feedback  can  be  provided  so  the  subject  can 
judge  the  accuracy  ot  the  reproduction  h\  lifting  a 
cover  sheet  on  the  Imagetics  material  which 
subsequently  hows  how  the  reproduction  matches 
the  standard.  \ii  objective  of  the  technique  is  to 
provide  a  means  lor  graphically  recording  students' 
responses  which  may  stimulate  and  develop  the 
students'  ability  to  mentally  visualize  and  recall 
previously  presented  material.  Materials  have  been 
developed  for  (a)  four  different  procedural  tasks  for 
the  I  -I  I  ID.  <»88.T  Converter  Flight  Controls  lest 
station,  inv  olv  ing  equipment  setup,  checkout,  power 
supply  adjustment,  and  control  settings,  and  (lit  four 
deductive  logic  tasks  involving  block  diagrams  and 
flow  diagrams. 

ImpnctU  lilizntion :  The  6883  imagery -based  task 
materials  have  been  experimentally  evaluated 
against  a  control  group.  Preliminary  results  indicate 
that  the  i  m age ry -based  strategy  produces 
significantly  more  recall  of  task  functions  during  the 
early  phases  of  training  and  appears  to  orient 
students  to  unfamiliar  task  environments  much 
faster  than  does  the  control  technique.  Due  to  the 
limited  availability  of  training  equipment  in  general, 
the  development  of  an  inexpensive  pretraining 
technique  with  apparently  powerful  learning  and 
motivating  capabilities  can  have  an  enormous  impact 
on  the  efficiency  and  subsequent  quality  of  training. 
T  his  technique  provides  a  breakthrough  in  paper- 
and-pcncil  training  methodology  through  the 
provisions  of  feedback,  interaction  with  materials, 
and  controlled  use  of  imagery.  The  strategies 
developed  for  improving  memory  and  acquisition  of 
information  in  performance-oriented  and  deductive 
logic  tasks  could  be  come  potentially  significant  C.A1 
strategies. 
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Authorized  Personnel  FY  79 


Officers 

53 

Airmen 

74 

Civilians 

238 

Total 

365 

Distribution  of  Authorized  Personnel  FY  79 


Personnel  Type 


FISCAL  HIGHLIGHTS 


Funding  Summary  ($1,000) 

Funding  Category 

FY  77 

FY  7T 

FY  78 

FY  79 

Laboratory  Director's  Fund 

$  405 

$  105 

$  450 

$  720 

Research  (6.1) 

556 

26 

429 

575 

Exploratory  Development  (6.2) 

8,855 

2,117 

10,865 

15,504 

Advanced  Development  (6.3) 

9,225 

2,198 

9,448 

4,600 

Interservice  Transfers  and  Reimbursables 

1,619 

2 

953 

2,095 

Total 

$20,660 

$4,448 

$22,145 

$23,494 

Distribution  of  FY  79  Expenditures  by  Laboratory  Thrust  Areas 
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l.ooper.  L.T..  &  Keswick.  F. A .  The  Development  of 
a  Refueling  Resource  and  Foal  Allocation 
Decision  Model.  Institute  of  Management 
Science/Operations  Research  Society  «f 
American  Meeting.  Slew  Orleans  LA.  May 
l*)7«). 

Maher,  F  A.  Determining  Maintenance  Resource 
Interact!'  ns  for  Aircraft  Systems.  Joint 
National  Meeting  of  the  Operations  Research 
Society  of  American  and  the  Institute  of 
Management  Sciences,  May  1 070. 

M  aher,  F.A .,  &  Asiala.  F.  Development  of  M  odels  of 
Maintenance  Resources  Interactions  for 
Aircraft  Systems.  Joint  National  M  eeting  of  the 
Operations  Research  Society  of  America  and 
the  institute  of  Management  Sciences,  May 
1 070 


Massey.  R.H..  Mullins.  F.J..  &  Fades.  J  A.  The 
F.onlent  Issue  in  Performance  Appraisal 
Ratings.  Proceedings.  20th  Annual  (Conference 
of  the  Military  Testing  Association.  Oklahoma 
Filv  OK.  November  1978. 

Mullins.  F  J  .  F.  arles.  J.A..  <X  Ratliff.  IK. 
Application  of  a  (Generalized  Development 
Furve  to  Problems  in  Human  Assessment. 
A  III  R  I.  Fonferenee  on  Human  Assessment. 
R rooks  AFR  T\  .  May  1 070. 

Nordhauser.  F.  (  list  of  OJ  I  -A1  icroeconomics  and 
F o s t  Accounting.  Tri-Service  Meeting  on 
F.conomics  of  H  liman  It  esottrees.  San  A  nlonio 
I  \  .  Jannarv  1 97'). 

O'Fnnnor.  T.J.  A  Veracity  Test  for  Technical 
Surveys.  87lh  Annual  American  Psychological 
Association  Fonvetition.  New  V  ork  NV. 
September  I  97'). 

Pina.  M.  A  FURL  Person  Job  Match  Research 
Project.  AFSF  ADP  Managers  Foitlereiice. 
Andrews  AFR  Ml).  October  l')78. 

Polk.  S.B.  Modeling  the  Air  Force  Manpower  and 
Personnel  System  for  Policy  Analysis,  1978 
Science  and  FCngineering  Symposium.  San 
Diego  F  A  .  Nov  cm  her  I ')  i  8. 

Ree.  M  J.  An  Automated  Flassifieation  System.  87th 
Annual  American  Psychological  Association 
(Convention,  New  York  NV  .  September  l')7'). 

Ree.  M.J..  X  Jensen.  H.FC.  The  F.ffects  of  Sample 
Size  on  Linear  liquating  on  Item  (Characteristic 
(Curve  Parameters.  (CAT  "79.  Minneapolis  MN. 
June  1979. 

Reed,  I..FC.  Psychological  Aspects  of  Sensor 
Simulation-Review  of  Air  Force  Sponsored 
Basie  Research:  Flight  and  Terhniral  Training 
Sciences.  liSAF"  Academy  (CO.  March  1979. 

Roberts.  D.K.  Kalman  Filtering  Based  on  State- 
Space  Model  Identification.  Flrd  Military 
Operations  Research  Society.  West  Point  NY. 
June  1979. 

Ruck,  II. W..  &  FCdwards,  J.O.  Measurement  of 
(Changes  in  Organizational  Kffectiveness  of 
Security  Police  Squadrons  Resulting  front  l 1  nit 
Reorganization.  1th  Annual  Workshop  on  the 
Role  ol  Behavioral  Science  in  Physical 
Security,  Washington  DF.  July  1979. 


Skinner.  VI  J.  Evaluation  of  the  Teehnieal  School 
Performance  of  Retrained  Airmen.  87th 
Annual  Vmeriean  Psychological  Association 
(Convention.  New  York  NY.  September  l1)!1). 

Taylor.  J.V  Participant.  Office  of  Naval  Research 
Personnel  Supplv  Workshop.  Springfield  \  A, 
May  1070. 

Chew.  MAC.  (CODAP:  A  New  Modular  Approach  to 
Occupational  Analysis.  20th  Annual 
(Conference  of  the  M  ilitary  Testing  Association, 
Oklahoma  (City  OK.  October  1078. 

Toedt.  D.  Merit  Pay  and  Related  Appraisal  issues. 
Officer  Effectiveness  Ratings  (Committee. 
Rrooks  APR  TX.  January  1070. 

Toedt.  D.  Merit  Pay.  l)ol)  (Committee  on  (Civilian 
Appraisal  System  Implementation.  Rrooks 
APR  TX.  February  1070. 

Toedt.  I).  Merit  Pay.  AFHRI.  Appraisal  (Conference 
and  Work  (Croup.  Rrooks  APR  TX.  March 
1070. 

Toedt.  I).  Merit  Pay  and  (Civil  Service  Reform  Act  of 
1078.  Federal  Executive  Association 
(Committee  on  (Compensation.  Rrooks  AFB 
TX.  May  1070. 

Toedt.  D.  Ergonomics  and  the  Occupational  Nursing 
Field.  Annual  M  eeting  of  the  Texas  Association 
of  Occupational  Nurses.  San  Antonio  TX. 
September  1070. 


V  alentine.  I..D.  Participant.  87th  Annual  American 
Psychological  Association  (Convention.  New 
York  NY,  September  1070. 

W'ard.  J.H.  Development  of  Instructional  Systems. 
Defense  l.anguage  Institute.  Lackland  APR 
TX.  November  1078. 

Ward.  J.H.  Policy  (Capturing  and  Policy  Specifying. 
Seminar  on  the  Approach  and  Methodology 
for  Gaining  New  Insight  into  Strategic  Nuclear 
Survival,  Washington  D(C,  May  1070. 

Ward,  J.H.  Policy  Specifying.  Navy  Personnel 
Research  and  Development  (Center.  San  Diego 
CA.  July  1070. 

Ward,  J.H.  Interaction  between  People 
(Characteristics  and  Job  Properties.  Navy 
Personnel  Research  and  Development  (Center. 
San  Diego  (CA.  August  1070. 

Ward.  J.H.  Grouping  and  Prediction.  (CODAP 
Workshop,  Brooks  AFB  TX.  September  1070. 

Wilbourn.  J.M.  Development  of  a  Promotion 
Potential  Assessment  System.  A  EEC  Directors 
of  Personnel  (Conference  on  Personnel,  Kelly 
AFB  TX.  June  1070. 


TECHNICAL  SYMPOSIA  AND  CONFERENCES 


In  FV  79.  AFHRI.  was  the  host  or  cohost  of  several  professional  symposia  and  conferences  that  brought 
together  experts  in  many  disciplines  to  report  on  new  research,  to  discuss  the  findings  of  current  projects,  and  to 
share  ideas  on  common  problems.  The  diversity  of  subjects  covered  by  these  meetings  is  shown  by  the  following 


January  1979  Tri-Serviee  Meeting  on  Fconom ics  of  Human 

Resources.  San  Antonio  TX 


July  1979  MAJCOM  Conference  on  OJT  R&  L)  Planning, 

Lowry  AFB  CO 


July  1979  DoD  Education  and  Training  Technical  Advisory 

Group.  Denver  CO 
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IEN.V  TO 
ATTN  OF: 

SUBJECT: 

TO: 


DEPARTMENT  OF  THE  AIR  FORCE 
AIR  FORCE  HUNAN  RESOURCES  LABORATORY  IAFSC) 
•ROOKS  AIR  FORCE  BASE.  TEXAS  78235 


TSR 

Removal  of  Export  Control  Statement 


1  6  JAN  1981 


Defense  Technical  Information  Center 
Attn:  DTIC/DDA  (Mrs  Crumbacker) 

Cameron  Station 
Alexandria  VA  22314 

1.  Please  remove  the  Export  Control  Statement  which  erroneously  appears  on 
the  Notice  Page  of  the  reports  listed  wartMBB!a985MIK .  This  statement  is 
intended  for  application  to  Statement  8  reports  only. 

2.  Please  direct  any  auestions  to  AFHRL/TSR,  AUTOVON  240-3877. 

FOR  THE  COMMANDER 

of  £J!cAs<l*ry\ 

WENDELL  L.  ANDERSON,  Lt  Col,  USAF 
Chief,  Technical  Services  Division 

Cy  to:  AFHRL/TSE 
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